I'd like some help determining whether a question I have about S3 object reindexing is on topic.
The Amazon S3 tag warns that support, functionality and configuration questions are off-topic. However, I believe my question boils down to: what is the runtime complexity for reindexing the unknown-to-me data structure underlying S3, which seems on topic.
Here is the content of the proposed question:
It seems you cannot rename an object on S3. An endless amount of answers here on SO indicate that the best you can do is copy the object, then delete the old one.
See various related questions:
- How to rename objects boto3 S3?
- Boto3/S3: Renaming an object using copy_object
- How to rename files and folder in Amazon S3?
- How to rename AWS S3 Bucket
According to these questions, this is true across various language APIs, including the AWS command line tools (the mv command warns that it just copies), and the online GUI (the rename action copies as well).
However, I have not found a clear technical reason for why this is the case. There are many key value data structures which allow reindexing.
In order to keep things on topic, here are some possible types of answers which I'll make up:
- The S3 system is backed by a ??? distributed block data structure, reindexing can't be atomic due to its decentralized nature, and multiple reindex commands even to all servers might put the system in a never ending cycle of reindexing or could violate data integrity. Aka the structure makes it impossible.
- The S3 system is backed by a ??? distributed block data structure, reindexing is theoretically possible, but only achieved by the following process which is a O(n^3) nightmare, making it prohibitively expensive to perform.
- This restriction has nothing to do with S3's technical implementation, which does allow reindexing, and AWS simply decided not to expose this functionality.
- Also acceptable: The S3 system is an absolute blackbox and AWS doesn't allow for its internal implementation to be known. The question cannot be answered with the information we have.