HDDS-8291. Upgrade to Hadoop 3.3.5 (#4484)

CI / coverage

CI / integration (client)

HDDS-8355. Mark TestOMRatisSnapshots#testInstallSnapshot as flaky

CI / coverage

CI / integration (flaky)

HDDS-5319. Disable flaky test TestSCMUpdateServiceGrpcServer#testClientUpdateWithRevoke

CI / coverage

CI / integration (om)

HDDS-7817. Add HTTP and HTTPS ports to DatanodeDetails (#4369)

CI / coverage

CI / integration (hdds)

HDDS-8334. ReplicationManager: Add nodes to exclude list if they are overloaded (#4510)

HDDS-8185. Implement JSON output for datanode list (#4508)

HDDS-8353. Mark TestBlockDeletion#testContainerStatisticsAfterDelete as flaky

HDDS-8273. EC: Validate replication config at server-side (#4507)

CI / coverage

CI / integration (ozone)

HDDS-8239. Backwards compatibility fix for new RATIS_DATASTREAM port (#4500)

CI / acceptance (compat)

CI / acceptance (misc)

CI / coverage

HDDS-5463. [FSO] Recon Container API does not work correctly with FSO. (#4182)

CI / basic (docs)

CI / coverage

HDDS-8320. Fix ranger jackson version conflict (#4504)

CI / acceptance (misc)

CI / coverage

HDDS-8323. [Snapshot] cancelAllBackgroundWork and close listeners in RDBStore#close (#4498)

CI / coverage

CI / integration (client)

HDDS-8313. Support rocksdb WAL ttl and size limit configuration (#4494)

CI / kubernetes

HDDS-8330. [Doc] Fix misplaced doc for GDPR.zh.md (#4502) Co-authored-by: wanghongbing <wanghongbing@didiglobal.com>

CI / coverage

CI / integration (filesystem)

HDDS-8309. ReplicationManager: Basic Throttling of EC Reconstruction commands (#4496)

HDDS-8134. Certificate clients are not correctly closed. (#4380)

CI / kubernetes

HDDS-8311. Fix list of supported units in Quota documentation

HDDS-6961. [Snapshot] Bootstrapping slow followers/new followers. (#3980) Co-authored-by: Hemant Kumar <hemantadhvaniya...

CI / acceptance (HA-secure)

CI / coverage

HDDS-8282. [Snapshot] Intermittent DB crash in RocksDBCheckpointDiffer (#4492)

CI / coverage

CI / integration (client)

HDDS-7914. [Snapshot] Block FS API access to deleted (non-active) snapshots (#4419)

CI / basic (unit)

CI / coverage

CI / integration (om)

HDDS-8276. EC file checksum calculation fails with topology-aware read enabled (#4495)

CI / basic (unit)

CI / coverage

CI / integration (ozone)

HDDS-8290. [Snapshot] Merge entries from snapshotRenamedKeyTable to next snapshot. (#4488)

HDDS-8293. In Network Topology documentation remove DNS configuration from Topology table mapping file. (#4485)

CI / acceptance (compat)

CI / coverage

HDDS-7994. Expose information via the ClusterState endpoint on keys and Directories marked for deletion (#4406)

HDDS-7855. Add hsync metrics in OM. (#4479)

HDDS-6633. Refactor upgrade acceptance tests to reduce code duplication. (#4456)

CI / coverage

CI / integration (filesystem)

CI / integration (om)

HDDS-8178. CertificateClient and KeyStoresFactory support multiple Sub-CA certificates in the trust chain (#4442)

CI / basic (unit)

CI / coverage

HDDS-8195. RDBStore.getUpdatesSince() throws RocksDBException: Requested array size exceeds VM limit (#4459)

CI / coverage

CI / integration (om)

HDDS-7952. [Snapshot] Server side changes to add job status and wait time to mimic the async behaviour for snapshot diff...

HDDS-7781. Change Get Key Info to return HSync info (#4460)

CI / coverage

CI / integration (om)

HDDS-8193. Ozone file systems to support Hadoop's PathCapabilities interface (#4452)

HDDS-7842. java.lang.NullPointerException: hadoop.ozone.container.keyvalue.statemachine.background.StaleRecoveringContai...

CI / coverage

CI / integration (client)

CI / integration (om)

HDDS-8257. RocksIterator not closed properly in LegacyBucketHandler (#4468)

CI / coverage

CI / integration (om)

HDDS-8274. Intermittent timeout in acceptance-MR test setup (#4475)

HDDS-8272. DBStore not closed properly in ReconStorageContainerManagerFacade (#4469)

CI / coverage

CI / integration (flaky)

HDDS-8288. Upgrade moment.js to 2.29.4 (#4483)

HDDS-8287. Add toString() method to ECContainerReplicaCount (#4481)

CI / coverage

CI / integration (flaky)

CI / integration (om)

HDDS-8275. ManagedWriteBatch is not closed properly in SCMHADBTransactionBuffer (#4476)

CI / coverage

CI / integration (filesystem)

CI / integration (om)

HDDS-8258. RocksIterator not closed properly in KeyValueHandler.logBlocksIfNonZero (#4471)

CI / coverage

CI / integration (om)

HDDS-8285. Eliminate leftover Guava Optional from CacheValue (#4482)

HDDS-8169. Delay Starting ContainerBalancer after SCM failover (#4458)

HDDS-7573. Use keyManager and trustManager provided by keyStoreFactory in Ratis group (#4464)

HDDS-5043. Consistently use user's short name in secure mode (#2466)

HDDS-7697. Restrict change of bucket properties to owner and admins in NativeACL (#4439)

HDDS-6064. Print proper JSON from `ozone debug ldb scan` (#4420)

HDDS-7540. Document separate scheduled CI (#4392)

HDDS-8281. Add IntelliJ code style scheme import recommendation in CONTRIBUTING.md (#4474)

HDDS-8128. Deduplicate the ops in RDBBatchOperation. (#4424)

HDDS-8240. Disable JaCoCo for PRs and in forks (#4449)

CI / coverage

CI / integration (om)

HDDS-8219. Run HA secure tests from s3g container (#4444)

HDDS-8244. Selective checks: handle change in junit.sh (#4450)

CI / coverage

CI / integration (scm)

HDDS-8279. [Snapshot] Switch RocksDB Tools JNI to release build (#4472) Change-Id: I14da8e2bb369e52c346939b906fd637306f...

HDDS-8263. [JDK17] Bump guice to 5.1.0, maven-shade-plugin to 3.4.1, remove guice-multibindings (#4462)

HDDS-7122. Add validation for EC chunk size (#4463)

HDDS-8223. SCM delete block service shoud run wait for safemode to exit. (#4432)

HDDS-8176. [Snapshot] Rename variables to fix shadow declaration warning with gcc (#4409)

HDDS-8265. [Snapshot] Close ManagedColumnFamilyOptions properly in OmSnapshotManager (#4465)

HDDS-7559. [Snapshot] Skip compaction tracking when no Ozone snapshot exists (#4418)

CI / coverage

CI / integration (om)

HDDS-8251. RocksIterator is not closed properly in snapshot (#4461)

HDDS-8255. Remove unnecessary sleep at secure container startup (#4457)

HDDS-8230. Let ReplicationManager decide the timeout for commands in Datanodes (#4453)

HDDS-8098. Make Schema V3 as default in ozone debug ldb for container db. (#4434)

CI / basic (unit)

CI / coverage

HDDS-8241. Transfer leader command doesn't work in secure cluster (#4454)

HDDS-7874. Disable flaky unit test: TestHddsSecureDatanodeInit.testCertificateRotationRecoverableFailure

HDDS-8155. SCM Block deleting service add transaction blocks for stale/dead/decommissioning DNs (#4403)

CI / basic (unit)

CI / coverage

CI / integration (ozone)

HDDS-8148. Improve log for Pipeline creation failure (#4385)

CI / acceptance (compat)

CI / coverage

HDDS-7853. Add support for RemoveSCM in SCMRatisServer. (#4358)

HDDS-8042. Display certificate issuer in cert list command. (#4429)

HDDS-8189. [Snapshot] renamedKeyTable should only track keys in buckets that has at least one active snapshot. (#4436)

HDDS-8154. Perf: Reuse Mac instances in S3 token validation (#4433)

HDDS-8245. Info log for keyDeletingService when nonzero number of keys are deleted. (#4451)

CI / acceptance (misc)

CI / coverage

HDDS-8233. ReplicationManager: Throttle delete container commands from over-replication handlers (#4447)

HDDS-8220. [Ozone-Streaming] Trigger volume check on IOException in StreamDataChannelBase (#4428)

HDDS-8173. Fix to remove enrties from RocksDB after container gets deleted. (#4445)

HDDS-7975. Rebalance acceptance tests (#4437)

HDDS-8152. Reduce S3 acceptance test setup time (#4393)

HDDS-8172. ECUnderReplicationHandler should consider commands already sent when processing the container (#4435)

HDDS-7883. [Snapshot] Accommodate FSO, key renames and implement OMSnapshotPurgeRequest for SnapshotDeletingService (#44...

HDDS-8168. Make deadlines inside MoveManager for move commands configurable (#4415)

HDDS-7918. EC: ECBlockReconstructedStripeInputStream should check for spare replicas before failing an index (#4441)

HDDS-8222. EndpointBase#getBucket should handle BUCKET_NOT_FOUND (#4431)

HDDS-8068. Fix Exception: JMXJsonServlet, getting attribute RatisRoles of Hadoop:service=OzoneManager. (#4352)

HDDS-8139. Datanodes should not drop block delete transactions based on transaction ID (#4384)

HDDS-8216. EC: OzoneClientConfig is overwritten in ECKeyOutputStream (#4425)

CI / coverage

CI / integration (flaky)

HDDS-8054. Fix NPE in metrics for failed volume (#4340)

CI / acceptance (HA)

CI / coverage

HDDS-8221. Fix misplaced OzoneKey javadoc comment (#4430)

HDDS-8217. Fix OmBucketInfo#equals for comparing defaultReplicationConfig (#4426)

HDDS-8205. Reorder OM nodes in HA acceptance tests (#4423)

HDDS-8187. ReplicationManager: Datanode commands should be sent to nodeManager directly (#4413)

HDDS-8204. Add testuser principals for all Ozone containers (#4422)

CI / acceptance (misc)

CI / coverage

HDDS-8171. Replicate commands could be sent to dead maintenance nodes if the same index is being decommissioned (#4412)

CI / coverage

CI / integration (client)

HDDS-8061. [Snapshot] Add SnapDiff client option to force a full diff (#4398)

CI / acceptance (compat)

CI / coverage

HDDS-8111. ReplicationManager: Add RatisMisReplicationHandler into rm.processUnderReplicatedContainer (#4414)

CI / basic (unit)

CI / coverage

HDDS-8149. Refactor the way to notify keyStoreFactory about certificate renewed (#4390)

HDDS-8160. [Snapshot] Skip the compaction entry from log and DAG if compaction input and output files are exactly same. ...

HDDS-8183. Fix edge case where delimiter is empty string in BucketEndpoint#get (#4410)

HDDS-8122. [Snapshot] Disable RocksDB column family auto compaction in SstFilteringService (#4400)

CI / acceptance (secure)

CI / coverage

CI / integration (filesystem)

CI / integration (om)

HDDS-7958. Ozone client not closed in integration tests (#4373)

HDDS-8167. Inject MoveManager into ContainerBalancer (#4411)

CI / acceptance (HA)

CI / coverage

CI / integration (client)

HDDS-8158. Replication Manager: Make all handlers send commands immediately instead of returning commands (#4399)

CI / coverage

CI / integration (client)

HDDS-8145. ReadReplicas should close client (#4387)

HDDS-8069. [Snapshot] Compaction DAG reconstruction logic potentially crashing OM on startup (#4401)

HDDS-7548. [Snapshot] SnapDiff pagination and partial diff report implementation (#4360)

HDDS-8041. Let Ozone Client fail faster with wrong OM address in URI. (#4325)

HDDS-7741. [Snapshot] Delete keys in snapshot scope from deleteTable during createSnapshot to accommodate snapshot garba...

HDDS-8099. Make unlimited length the default in ozone debug ldb. (#4404)

HDDS-6449. Failed container delete can leave artifacts on disk (#3741) * cleanUpManager - tmpDir - rename container pat...

HDDS-7867. Clean up replication logs (#4397)

CI / coverage

CI / integration (ozone)

HDDS-8153. Integrate ContainerBalancer with MoveManager (#4391)

CI / basic (unit)

CI / coverage

CI / integration (hdds)

HDDS-8090. When getBlock from a datanode fails, retry other datanodes. (#4357)

HDDS-8163 Use try-with-resources to ensure close rockdb connection in SstFilteringService (#4402)

CI / acceptance (secure)

CI / coverage

CI / integration (om)

HDDS-8065. Provide GNU long options (#4394)

CI / coverage

CI / integration (om)

HDDS-7930. [addendum] input stream does not refresh expired block token. Change-Id: Ifa4ecf124b7ccdcb4cbc5cb371857aee67...

CI / coverage

CI / integration (filesystem)

HDDS-7930. input stream does not refresh expired block token. (#4378)

CI / coverage

CI / integration (filesystem)

HDDS-7740. [Snapshot] Implement SnapshotDeletingService (#4244)

CI / coverage

CI / integration (flaky)

HDDS-8076. Use container cache in Key listing API. (#4346)

CI / acceptance (HA)

CI / coverage

CI / integration (ozone)

HDDS-8091. [addendum] Generate list of config tags from ConfigTag enum - Hadoop 3.1 compatibility fix (#4374)

HDDS-8144. TestDefaultCertificateClient#testTimeBeforeExpiryGracePeriod fails as we approach DST. (#4382)

HDDS-8151. Support fine grained lifetime for root CA certificate (#4386)

HDDS-8150. RpcClientTest and ConfigurationSourceTest not run due to naming convention (#4388)

HDDS-8131. Add Configuration for OM Ratis Log Purge Tuning Parameters. (#4371)

CI / acceptance

CI / basic (author)

CI / build (8)

CI / compile

CI / coverage

CI / dependency

CI / kubernetes

HDDS-8133. Create ozone sh key checksum command (#4375)

HDDS-8142. Check if no entries in Block DB for a container on container delete (#4379)

HDDS-8118. Fail container delete on non empty chunks dir (#4367)

HDDS-8028. JNI for RocksDB SST Dump tool (#4315)

CI / acceptance (compat)

CI / coverage

CI / integration (ozone)

HDDS-8129. ContainerStateMachine allows two different tasks with the same container id running in parallel. (#4370)

HDDS-8119. Remove loosely related AutoCloseable from SendContainerOutputStream (#4368)

close db connection (#4366)

CI / acceptance (MR)

CI / coverage

HDDS-8110. ReplicationManager: Introduce basic limits on ReplicateContainer commands (#4364)

CI / acceptance (misc)

CI / basic (unit)

CI / coverage

HDDS-8091. Generate list of config tags from ConfigTag enum (#4359)

HDDS-8095. Unbuffer not supported in TDE buckets (#4361)

CI / acceptance (secure)

CI / coverage

HDDS-8087. Intermittent crash in TestHddsDatanodeService (#4353)

CI / coverage

CI / integration (flaky)

CI / kubernetes

HDDS-8086. Bump snakeyaml from 1.33 to 2.0 (#4355) Co-authored-by: rohit-kb <115476286+rohit-kb@users.noreply.github.co...

HDDS-8112. ECReconstructionCoordinator is not closed (#4365)

CI / coverage

CI / integration (om)

HDDS-8108. gRPC channel created for replication client not shutdown properly (#4363)

CI / basic (unit)

CI / coverage

HDDS-8038. [Snapshot] Add a smoketest for Snapshot with ACLs (#4322)

HDDS-8014. [Snapshot] Implement Native Acl Integration tests for Snapshotting (#4301)

Merge remote-tracking branch 'origin/HDDS-5447-httpfs'

HDDS-8030. Cleanup unused/unnecessary code related to CertificateClient (#4317)

HDDS-5447. HttpFS support in Ozone (#4356)

CI / basic (unit)

CI / coverage

HDDS-7950. [Snapshot] API changes to support pagination token and async nature of snapshot diff API (#4264)

HDDS-8074. Improve synchronization around command queue updates in Node Manager (#4341)

HDDS-7816. Add DataNode list to the SCM WebUI (#4289)

HDDS-8073. Replace Usages of LegacyReplicationManager.MoveResult with MoveManager.MoveResult (#4339)

HDDS-6802. Implement JSON output for pipeline list CLI (#4343)

CI / basic (unit)

CI / coverage

HDDS-7137. Add CLI for Getting the failed deleted block txn (#3691)

HDDS-8079. RocksDB included in client libs doubles shaded jar size (#4349)

HDDS-8078. Github CI: Allow PR title starting with Revert (#4348)

HDDS-8077. Enforce new checkstyle: NewlineAtEndOfFile (#4347)

HDDS-8046. Eliminate embedded newlines from config properties (#4328)

HDDS-8057. Handle unchecked exception in KeyValueHandler more gracefully (#4334)

HDDS-8024. When readChunk from a datanode fails, retry other datanodes. (#4336)

CI / acceptance (HA)

CI / acceptance (compat)

CI / coverage

CI / dependency

HDDS-8075. ECReconstructionCoordinatorTask.runTask should catch Exception (#4342)

HDDS-7210. Missing open containers show up as "Closing" on the container report. (#4207) * HDDS-7210 Enable HealthState...

HDDS-8029. [hsync] Outputstream in encrypted buckets do not return the correct stream capabilities. (#4316)

HDDS-7984. [Snapshot] Store Ozone keys ever renamed in renamedKeyTable for efficient lookup in SnapshotDeletingService (...

HDDS-8070. DBCheckpointMetrics is not unregistered during OM stop. (#4338)

HDDS-7905. [Snapshot] Snapdiff should only return modifications done to the bucket. (#4273)

CI / acceptance (misc)

CI / coverage

HDDS-6176. Ozone service WebUI is not accessible with 404 error. (#4308)

HDDS-7934. NPE in RandomKeyGenerator's shutdown hook (#4286)

HDDS-8019. IllegalStateException: call already closed at GrpcXceiverService.onCompleted (#4335)

HDDS-7156. Reset pending delete block count (#4324) * HDDS-7156: Reset pending delete block count Reset pending dele...

HDDS-7869. Log configuration on component startup. (#4271)

HDDS-8006. [snapshot] Add unit test cases for snapshot delete (#4331)

HDDS-8032. SCM support reconfigurable dynamically (#4318)

HDDS-7926. [hsync] Recon throws ClassCastException. (#4266)

CI / coverage

CI / integration (client)

HDDS-534. Remove unsupported jmxget subcommand (#4326)

HDDS-7906. Addendum: [Snapshot] Wait for checkpoint creation if snapshot in cache and not committed to DB. (#4306)

HDDS-7959. Improve log in ECBlockInputStream and ECBlockReconstructedStripeInputStream (#4323)

CI / basic (checkstyle)

CI / coverage

Revert "HDDS-8006. [snapshot] Add unit test cases for snapshot delete (#4297)" (#4330) This reverts commit 0349c8e8a9b5...

HDDS-8006. [snapshot] Add unit test cases for snapshot delete (#4297)

CI / coverage

CI / integration (om)

HDDS-8044. Ensure GrpcOutputStream is closed (#4327)

HDDS-7183. Expose RocksDB critical properties. (#3875)

CI / acceptance (unsecure)

CI / coverage

CI / integration (ozone)

HDDS-8036. Unprotected flush in SCMHADBTransactionBuffer (#4319)

HDDS-6241. Follower SCM node repeatedly sending requests to Ratis server. (#4302)

HDDS-7505. Recon: Rename OM DB Sync to DB Sync on UI (#3988)

CI / coverage

CI / integration (om)

HDDS-8037. Improve logging in EC Reconstruction putBlock precondition check (#4320)

HDDS-8024. Mark TestHSync#testOfsHSync as flaky

HDDS-8034. Check container replication health before scheduling move in MoveManager (#4321)

HDDS-8035. Mark TestHSync#testO3fsHSync as flaky

CI / acceptance (MR)

CI / coverage

CI / integration (client)

HDDS-7590. Use keyManager and trustManager provided by keyStoreFactory in om grpc services (#4145)

HDDS-8008. Move pendingOps into ContainerStateManagerImpl to ensure consistent state (#4298)

CI / coverage

CI / integration (om)

HDDS-8026. Replace import from shaded Guava (#4314)

CI / acceptance (unsecure)

CI / coverage

HDDS-8025. ReplicationManager: Count a container once for missing, under, mis or over replicated (#4313)

CI / coverage

CI / integration (filesystem)

CI / integration (ozone)

HDDS-8020. File checksum helper leaking client (#4307)

HDDS-7890. Refactor ContainerDeletionChoosingPolicy implementations (#4303)

CI / basic (unit)

CI / coverage

HDDS-7973. Let RatisMisReplicationHandler use the new RatisContainerReplicaCount constructor (#4305)

HDDS-8012. Clean up after link loop test (#4304)

HDDS-8009. OM HA metrics should be unregistered if leader is not known (#4300)

HDDS-7782. OM lease recovery for hsync'ed files. (#4255)

HDDS-7983. Intermittent OutOfMemoryError in TestOzoneRpcClientWithRatis#testUploadWithStreamAndMemoryMappedBuffer. (#429...

HDDS-7982. NPE in BlockInputStream due to null pipeline after refresh (#4296)

HDDS-7839. Upgrade Weld to 3.1.9 (#4299)

HDDS-7998. Synchronize on containerInfo in ReplicationManager and MoveManager (#4295)

HDDS-7993. [snapshot] Add testcase to handle snapshot name minimum-length (#4293)

HDDS-7991. Do not return fake parent dir for deleted keys (#4287)

HDDS-7721. Make OM Ratis roles available in /prom endpoint (fix compile error)

HDDS-7721. Make OM Ratis roles available in /prom endpoint (#4140)

CI / acceptance

CI / basic (findbugs)

CI / basic (unit)

CI / build (8)

CI / compile

CI / coverage

CI / dependency

CI / integration (client)

CI / integration (filesystem)

CI / integration (flaky)

CI / integration (hdds)

CI / integration (om)

CI / integration (ozone)

CI / integration (scm)

CI / kubernetes

HDDS-6743. Specify leader node for OM failover (#3409) * HDDS-6743. Specify leader node for OM failover * HDDS-6743....

CI / coverage

CI / integration (om)

HDDS-7906. [Snapshot] Wait for checkpoint creation if snapshot in cache and not committed to DB. (#4249)

HDDS-7989. UnhealthyReplicationProcessor retries failure without delay (#4285)

CI / coverage

CI / integration (filesystem)

HDDS-7971. Support SCM transfer Ratis leadership (#4276)

HDDS-7064. S3 get-object response emits tracing spans outside ObjectEndpoint#get (#4288)

HDDS-7588. Intermittent failure in TestObjectStoreWithLegacyFS#testFlatKeyStructureWithOBS (#4290)

HDDS-7710. Support AWS s3 ListObjects API's encodingType request parameter (#4127)

Revert "HDDS-7588. Intermittent failure in TestObjectStoreWithLegacyFS#testFlatKeyStructureWithOBS (#4040)" This revert...

CI / acceptance (HA)

CI / coverage

HDDS-7988. Run S3 tests with HA Proxy (#4284)

HDDS-7596. Fix OM crash due to a corner case for FSO-enabled bucket (#4048)

HDDS-7301. Cleanup OmUtils (#3812)

HDDS-7461. Require CREATE right on volume instead of WRITE for CREATE_BUCKET operation (#3938)

HDDS-7178. [Multi-Tenant] Use optimistic read in Ranger background sync (#3725)

HDDS-6572. EC: ReplicationManager - add move manager for container move (#4274)

HDDS-7379. Use certificate bundles instead of the sole certificate (#4231)

CI / coverage

CI / integration (filesystem)

HDDS-7976. FsShell creates unrelated trace spans (#4281)

CI / coverage

CI / integration (filesystem)

HDDS-7980. Force Close QUASI_CLOSED replicas of CLOSED containers in RM (#4283)

CI / coverage

CI / integration (filesystem)

HDDS-7556. Translate EC doc into Chinese (#4263)

CI / coverage

CI / integration (filesystem)

HDDS-7969. CacheValue should not store value as an Optional. (#4275)

HDDS-7931. EC: ManagedChannelImpl not cleaned up properly (#4269)

HDDS-7832. Support FSO buckets for FileSizeCountTask. (#4206)

HDDS-7865. [Snapshot] Add test for getFileStatus and readFile from snapshot paths. (#4232) * HDDS-7865. [Snapshot] Add ...

HDDS-4223. Optimize the construction method of OzoneVolume and OzoneBucket. (#4262) Co-authored-by: wanghongbing <wangh...

CI / coverage

CI / integration (filesystem)

HDDS-7967. Replace Hadoop annotations with Ozone-specific ones (#4279)

HDDS-7964. Enable ratis pre-vote in Ozone by default. (#4272)

HDDS-7800. [Snapshot] Use persistent map and set to generate snapshot diff report (#4190)

HDDS-7919. EC: ECPipelineProvider.createForRead should filter out dead replicas and sort replicas (#4277)

HDDS-7962. Add configuration flag to enable LegacyReplicationManager for RATIS containers (#4270)

CI / basic (unit)

CI / coverage

HDDS-7866. [Snapshot] Fix ConcurrentModificationException in snapdiff API. (#4233)

HDDS-7594. [FSO] Folders created through S3G are created on file system as "files". (#4186)

HDDS-7847. Handle Replication of Unhealthy Replicas in RM (#4227)

HDDS-7617. Remove flaky tag from TestECContainerRecovery

CI / acceptance (MR)

CI / coverage

HDDS-7617. Intermittent timeout in TestECContainerRecovery (#4268)

HDDS-7687. Support OM transfer Ratis leadership (#4265)

CI / coverage

CI / integration (filesystem)

HDDS-7667. [Admin Doc] Observability: Add Grafana integration (#4267)

HDDS-7513. [Snapshot] Support list snapshots using fs -ls (#4134)

HDDS-7634. Recon: Show Datanode UUID on Pipeline page (#4135)

HDDS-7944. Add dash-separated-options where missing (#3943)

HDDS-7829. SCM to reject adding container to closed pipeline (#4212)

HDDS-7920. User cannot list their own volumes without access to root volume (#4254)

HDDS-7928. EC: Change ContainerReplicaPendingOps to store deadline rather than scheduled time (#4260)

HDDS-7923. [EC] Reconstruction is failing with IndexOutOfBoundsException (#4258)

HDDS-7815. Extract S3 secret layer (#4196)

HDDS-7924. Remove non-conflicting transitive-only dependency versions (#4261)

HDDS-7915. Force close QUASI_CLOSED replicas only when the container is CLOSED in Legacy RM (#4259)

CI / coverage

CI / integration (flaky)

HDDS-7871. Fix false positive in KeyManagerImpl#createFakeDirIfShould() (#4236)

CI / coverage

CI / integration (om)

HDDS-6056. Recon /containers endpoint should return SCM container data instead of OM container data. (#4158)

HDDS-7799. Add container count to datanode usage info (#4209)

HDDS-7921. Migrate TestKeyManagerImpl to JUnit5 (#4257)

HDDS-7917. EC: ECBlockInputStream should try spare replicas on error (#4253)

CI / basic (unit)

CI / coverage

HDDS-7321. Auto rocksDB small sst files compaction. (#3908) * HDDS-7321. Auto rocksDB small sst files compaction. Co...

CI / coverage

CI / integration (flaky)

HDDS-7857. Apply custom RocksDB log configuration for all schema versions (#4223)

HDDS-6444. Apply HDDS-5875 to OMKeyCommitRequestWithFSO (#3250)

HDDS-7617. Mark TestECContainerRecovery as flaky

HDDS-7489. Create a Freon tool to simulate datanodes (#4126)

HDDS-7764. Potential discrepancy of key creation time may cause premature open key clean up. (#4242)

CI / coverage

CI / integration (filesystem)

HDDS-3265. Intermittent timeout in TestRatisPipelineLeader (#4248)

HDDS-7864. Add integration test for replication (#4238)

CI / basic (unit)

CI / coverage

HDDS-7851. Apply flush and compact on all column families (#4219)

CI / coverage

CI / integration (flaky)

HDDS-7854. Recon NPE when trace enabled (#4222)

HDDS-7382. FSO bucket `rename` supports change modification time of parent dir (#3953)

CI / coverage

CI / integration (hdds)

HDDS-7082. Delete out of date audit logs (#3647)

HDDS-7126. Clean deletedBlock records of deleted containers (#3683) =

HDDS-7578. Wrong directory config used for SCM HA Ratis Snapshot (#4030)

HDDS-7863. Remove OzoneStreamCapabilities (#4247)

HDDS-7091. Filter containers with pending deletion blocks before checking policy (#3655)

HDDS-7306. DeleteBlock retry count increased at incorrect place (#3818)

CI / acceptance

CI / build (8)

CI / compile

CI / coverage

CI / dependency

CI / integration (om)

CI / kubernetes

HDDS-7838. gRPC channel created block input/output stream not shutdown properly (#4215)

CI / coverage

CI / integration (flaky)

HDDS-7747. Document jq filtering examples for CLI responses. (#4157)

CI / coverage

CI / integration (filesystem)

HDDS-7783. Add compile platform info in 'ozone version' command output (#4177)

HDDS-7881. Intermittent timeout in basic acceptance test (#4243)

HDDS-7450. Improve bucket creation message (#3997)

CI / coverage

CI / integration (flaky)

HDDS-3591. ozone.administrators support dynamic changes through the cli. (#4221) * HDDS-3591. ozone.administrators supp...

HDDS-7886. Mark parts of TestRatisPipelineCreateAndDestroy as flaky

CI / coverage

CI / integration (flaky)

HDDS-7277. [Snapshot] Implement snapshot key listing in Ozone Shell (#4125)

HDDS-7873. [Snapshot] Prune backup SST files that can be expanded periodically (#4235) (cherry picked from commit 506a0...

HDDS-4303. Ensure LayoutVersion is unique and monotonicaly increasing in LayoutFeature enums (#4224) * Standardize Layo...

CI / acceptance (MR)

CI / acceptance (unsecure)

CI / coverage

CI / integration (hdds)

HDDS-7868. Intermittent failure in TestOmAcls (#4239)

CI / coverage

CI / integration (flaky)

HDDS-7879. Intermittent BindException in HA integration tests (#4241)

CI / coverage

CI / integration (filesystem)

HDDS-7688. Ozone Manager change to support HSync. (#4211)

HDDS-5626. Mark parts of TestAddRemoveOzoneManager, TestBlockOutputStreamFlushDelay and TestFailureHandlingByClient as f...

HDDS-7850. Bump maven-enforcer-plugin version to 3.2.1 (#4218)

CI / coverage

CI / integration (hdds)

HDDS-7874. Disable flaky unit test: TestHddsSecureDatanodeInit.testCertificateRotation

CI / coverage

CI / integration (scm)

HDDS-7826. Add support for application to probe output stream capability (#4205)

CI / basic (unit)

CI / coverage

Merge remote-tracking branch 'asf/HDDS-6517-Snapshot' Change-Id: I98122590b3b5c81d6d7afd24ae56a6b0d43eca5e

CI / coverage

CI / integration (om)

HDDS-7821. Let push replication use compression from configuration (#4229)

CI / coverage

CI / integration (scm)

HDDS-7859. ICR processing does not remove container reference in NodeManager for a deleted replica (#4228)

CI / coverage

CI / integration (client)

CI / integration (om)

HDDS-7856. Fix timeout in TestPushReplicator (#4225)

CI / coverage

CI / integration (om)

HDDS-7844. EC: Add normal and low priority to replication supervisor and commands (#4220)

CI / coverage

CI / integration (client)

CI / integration (om)

HDDS-7856. Disable flaky TestPushReplicator until fixed

CI / acceptance (secure)

CI / coverage

HDDS-6847. Audit for ALLOCATE_BLOCK should indicate number of allocated blocks (#3518)

CI / basic (unit)

CI / coverage

HDDS-7778. Add metrics for push replication (#4217)

CI / basic (unit)

CI / coverage

HDDS-7770. Recon namespace summary endpoint to carry basic entity information as well (#4170)

CI / acceptance (secure)

CI / coverage

CI / integration (client)

HDDS-7806. Add unit tests for push replication (#4216)

CI / coverage

CI / integration (flaky)

CI / integration (om)

HDDS-7372. Fix missing jars in classpath by specifying jar versions (#4097)

CI / coverage

CI / integration (filesystem)

HDDS-7808. Intermittent failure in TestReplicationManager#testUnderReplicationQueuePopulated (#4213)

CI / coverage

CI / integration (ozone)

HDDS-7841. EC: Remove ECReconstructionSupervisor and send reconstruction commands to ReplicationSupervisor (#4210)

CI / coverage

CI / integration (ozone)

HDDS-7496. Make default bucket layout FSO in a backwards compatible way. (#3966)

CI / coverage

CI / integration (client)

HDDS-7818. Modify Ratis Replication Handling in the new RM (#4204)

CI / basic (unit)

CI / coverage

HDDS-7834. Remove unnecessary streams (#4208)

HDDS-7822. Allow multiple commands per datanode in UnhealthyReplicationHandler (#4203)

CI / coverage

CI / integration (client)

HDDS-7833. EC: Refactor ReplicationSupervisor to allow Replication and ECReconstruction tasks (#4202)

CI / basic (unit)

CI / coverage

HDDS-7825. Warn when EC write exception occurs (#4201) Normalize logStreamError so that EC write errors are logged at W...

CI / coverage

CI / integration (client)

HDDS-7820. Store container descriptor at start of tar archive (#4200)

CI / coverage

CI / integration (ozone)

HDDS-7777. Implement container replication in push model (#4197)

CI / coverage

CI / integration (hdds)

HDDS-7792. Fix package name typos in o.a.h.hdds.security.x509 (#4184)

HDDS-7097. Container scanner log output lacks useful information (#4169)

HDDS-7813. Handle Mismatched Replicas (OPEN or CLOSING) of QUASI-CLOSED containers in RM (#4195)

CI / acceptance (unsecure)

CI / coverage

CI / integration (scm)

CI / kubernetes

HDDS-7625. Do not compress OM/SCM checkpoints (#4130)

HDDS-7801. Bucket not found when calling getKeyInfo with tenant context (#4189)

HDDS-7807. TarContainerPacker closes streams multiple times (#4193)

HDDS-7755. Ensure that acquired locks are always released. (#4191)

HDDS-7804. UNHEALTHY replicas will not contribute to sufficient replication in RatisContainerReplicaCount (#4192)

HDDS-7748. Rename OMFileRequest.addToOpenFileTable() to avoid misuse. (#4176)

CI / coverage

CI / integration (client)

CI / integration (filesystem)

HDDS-7723. Refresh Keys and Certificate used in OzoneSecretManager after certificate renewed (#4179)

HDDS-7788. Ratis OverReplicationHandler should exclude stale replicas (#4183)

CI / coverage

CI / integration (om)

HDDS-7718. Bump Netty to 4.1.86 and gRPC to 1.51.1 (#4139)

HDDS-7542. Refactor DefaultReplicationConfig (#4005)

HDDS-7787. GetChecksum for EC files can fail intermittently with IndexOutOfBounds exception (#4180)

CI / basic (unit)

CI / coverage

HDDS-7754. Download of container is failing with SSL/TLS error during re-replication (#4174)

CI / basic (unit)

CI / coverage

HDDS-7455. ClassCastException: OzoneTokenIdentifier cannot be cast to String (#4159)

CI / coverage

CI / integration (hdds)

HDDS-7441. Rename function names of retrieving metadata keys (#3918)

HDDS-7722. FSO buckets fail to invalidate open file table cache when committing a key (#4156)

CI / coverage

CI / integration (client)

HDDS-7774. Update outdated Trash documentation (#4172)

HDDS-7761. EC: ReplicationManager - Use placementPolicy.replicasToRemoveToFixOverreplication in EC Over replication hand...

HDDS-7775. EC: Exception encountered while deleting UNHEALTHY replica in Datanode (#4173)

CI / coverage

CI / integration (client)

CI / integration (scm)

HDDS-7570. Provide a shareable ofs://temp directory (#4027)

HDDS-7751. Volume quota must have all bucket quota set (#4165)

CI / kubernetes

HDDS-5934. Add OM NodeID to VERSION file. (#4138) Co-authored-by: Hanisha Koneru <hanishakoneru@apache.org>

HDDS-7083. Spread container-copy directories (#3648)

CI / acceptance (HA)

CI / basic (unit)

CI / coverage

HDDS-7760. Let ContainerDataConstructor extend SafeConstructor (#4162)

CI / basic (unit)

CI / coverage

CI / integration (flaky)

HDDS-6447. Refine SCM handling of unhealthy container replicas. (#3920)

HDDS-5541. Namespace summary endpoint can carry basic information on the entity as well. (#4042)

CI / coverage

CI / integration (client)

CI / integration (ozone)

HDDS-7753. Simplify DatanodeDetails#toString to improve log messages (#4161)

CI / coverage

CI / integration (client)

CI / integration (om)

HDDS-7705. Fix OM Bootstrap request (#4160)

CI / coverage

CI / integration (flaky)

CI / integration (ozone)

HDDS-7630. Show detailed OMResponse when OzoneManagerDoubleBuffer terminates (#4075)

HDDS-7638. Ozone client change to support HSync. (#4104)

CI / coverage

CI / integration (hdds)

HDDS-7560. Placement Policy Interface changes to handle Overreplication (#4014)

HDDS-4539. Container Health Task should not run until Recon has reached steady state. (#4049)

CI / coverage

CI / integration (ozone)

CI / integration (scm)

HDDS-7726. EC: Enhance datanode reconstruction log message (#4155)

CI / basic (unit)

CI / coverage

HDDS-7739. EC: Increase the information in the RM sending command log message (#4153)

HDDS-7652. Volume Quota not enforced during write when bucket quota is not set (#4124)

HDDS-7628. Intermittent failure in TestOzoneContainerWithTLS (#4142)

CI / acceptance (secure)

CI / coverage

HDDS-7695. EC metrics related to replication commands don't add up (#4152)

CI / coverage

CI / integration (client)

HDDS-7729. EC: ECContainerReplicaCount should handle pending delete of unhealthy replicas (#4146)

HDDS-7738. SCM terminates when adding container to a closed pipeline (#4154)

CI / acceptance (secure)

CI / coverage

CI / integration (hdds)

HDDS-7243. Remove RequestFeatureValidator from echoRPC method which supports only ValidationCondition.OLDER_CLIENT_REQUE...

HDDS-7708. No check for certificate duration config scenarios. (#4149)

CI / coverage

CI / integration (client)

HDDS-7727. EC: SCM unregistered event handler for DatanodeCommandCountUpdated (#4147)

CI / basic (unit)

CI / coverage

HDDS-7606. Add SCM HA support in intellij run (#4058) * HDDS-7606. Add SCM HA support in intellij run.

CI / acceptance (HA)

CI / basic (unit)

CI / coverage

HDDS-7666. EC: Unrecoverable EC containers with some remaining replicas may block decommissioning (#4118)

HDDS-7339. Implement Certificate renewal task for services (#3982)

CI / coverage

CI / integration (om)

CI / integration (scm)

HDDS-7696. MisReplicationHandler does not consider QUASI_CLOSED replicas as sources (#4144)

HDDS-7714. Docker cluster ozone-om-ha fails during docker-compose up (#4137)

CI / coverage

CI / integration (ozone)

HDDS-7716. Log read requests rejected with permission denied in OM audit (#4136)

HDDS-7588. Intermittent failure in TestObjectStoreWithLegacyFS#testFlatKeyStructureWithOBS (#4040)

CI / coverage

CI / integration (flaky)

HDDS-7633. Compile error with Java 11: package com.sun.jmx.mbeanserver is not visible (#4077)

CI / coverage

CI / integration (client)

CI / integration (flaky)

HDDS-7648. Add a servername tag in UGI metrics. (#4094)

CI / basic (unit)

CI / coverage

CI / integration (filesystem)

HDDS-7564. Update Ozone version after 1.3.0 release (#4115)

CI / acceptance (unsecure)

CI / coverage

CI / integration (filesystem)

HDDS-7409 [doc] Update documents for better presentation (#3884) Co-authored-by: wanghongbing <wanghongbing@didiglobal....

CI / coverage

CI / integration (hdds)

HDDS-7623. Do not compress container re-replication traffic by default (#4089)

HDDS-7525. Migrate key digest from MD5 to SHA256 in Ozone shell

HDDS-7584. Addition of new OM node expels itself from the Ratis ring after restart (#4074)

CI / acceptance (misc)

CI / coverage

CI / integration (client)

CI / integration (hdds)

HDDS-7644. S3 multipart upload does not update quota namespace for missing parents (#4091)

CI / coverage

CI / integration (flaky)

HDDS-7641. Namespace quota validation is not present in multiple places (#4082)

HDDS-7661. Ratis Misreplication Handler (#4100)

CI / coverage

CI / integration (om)

HDDS-7692. Remove usage of MonotonicClock and use default system clock instead (#4121)

CI / coverage

CI / integration (scm)

HDDS-3486. Recon cannot track missing containers that were created and went missing while it is down. (#3947)

HDDS-7576. Prometheus metrics do not remove stale metrics until restart (#4057)

HDDS-7684. Embed Matomo Web Analytics tracking code in docs. (#4111) Change-Id: Ia93f96acb8321233ac280c259007ba2be8ae52...

HDDS-5331. Recon: Trigger PipelineSyncTask when DN becomes stale and ContainerHealthTask when DN becomes dead. (#4011)

CI / basic (unit)

CI / coverage

HDDS-7631. Log format error on quotas when exceeding the space quota (#4076) * Change error message

HDDS-7686. Cherry-pick proto.lock files change from ozone-1.3 release branch to master (#4113)

CI / acceptance (misc)

CI / coverage

CI / integration (ozone)

HDDS-7473. Ratis integration for support of remove registeration (#4112)

HDDS-7463. SCM Pipeline scrubber never able to cleanup allocated pipeline. (#4093)

HDDS-7683. EC: ReplicationManager - UnderRep maintenance handler should not request nodes if none needed (#4109)

HDDS-7635. Update failure metrics when allocate block fails in preExecute. (#4086)

HDDS-7565. FSO purge directory for old bucket can update quota for new bucket (#4021) * HDDS-7565. FSO purge directory ...

CI / coverage

CI / integration (hdds)

CI / integration (ozone)

HDDS-7654. EC: ReplicationManager - merge mis-rep queue into under replicated queue (#4099) Co-authored-by: S O'Donnell...

CI / coverage

CI / integration (client)

HDDS-7621. Update SCM term in datanode from heartbeat without any commands (#4101)

HDDS-7649. S3 multipart upload EC release space quota wrong for old version (#4095)

HDDS-7399. Enable specifying external root ca (#4053)

CI / acceptance (secure)

CI / coverage

CI / integration (client)

CI / integration (filesystem)

HDDS-7398. Tool to remove old certs from the scm db (#3972)

HDDS-6650. S3MultipartUpload support update bucket usedNamespace. (#4081)

HDDS-7605. Improve logging in Container Balancer (#4067)

CI / coverage

CI / integration (ozone)

HDDS-7616. EC: Refactor Unhealthy Replicated Processor (#4063)

CI / coverage

CI / integration (flaky)

HDDS-7426. Add a new acceptance test for Streaming Pipeline. (#4019) (cherry picked from commit fb13d46ca6b8fd94971df29...

CI / acceptance (misc)

CI / coverage

CI / integration (om)

HDDS-7371. Create properties for all dependency versions (#4059)

HDDS-7620. Check term for async commands before processing (#4096)

HDDS-7521. EC: Misreplication Handler changes for Placement Policy interface changes (#4061)

CI / coverage

CI / integration (flaky)

HDDS-7636. Remove hadoop security dependency in org.apache.hadoop.hdds.security.ssl package (#4080)

HDDS-7628. Disable flaky TestOzoneContainerWithTLS#testCreateOzoneContainer

HDDS-7642. EC: Add debug logging to the Replication Manager check handlers (#4087)

CI / coverage

CI / integration (client)

CI / integration (filesystem)

CI / integration (ozone)

HDDS-7592. Recursive delete of directory multiple time impacts some directory not removed (#4068)

HDDS-7627. EC: Bug fix for calculating Misreplication Count (#4088)

CI / basic (unit)

CI / coverage

HDDS-7643. rocksdb iterator is not closed properly (#4084)

HDDS-7503. CLI admin namespace -quota should return whole file system disk capacity consumed by all replicas (#3976)

HDDS-7582. ECUnderReplicationHandler does not consider pending adds when finding targets (#4085)

HDDS-7640. EC: UNHEALTHY replicas not replaced by healthy replicas from a CLOSED container by RM (#4083)

HDDS-7008. Mark TestOzoneHARatisLogParser as flaky (#4078)

CI / coverage

CI / integration (ozone)

HDDS-7619. Update SCM term in datanode when command is received (#4072)

CI / basic (unit)

CI / coverage

HDDS-7591. Add a handler for over replicated Ratis containers to RM (#4055)

HDDS-7628. Disable flaky TestOzoneContainerWithTLS#testContainerDownload

HDDS-7618. Replication Commands should timeout if not processed on datanodes in time (#4069)

CI / coverage

CI / integration (ozone)

HDDS-7595. Add OmId in OM's UI (#4047)

CI / coverage

CI / integration (om)

HDDS-7589. Unify multipart stream reading. (#4041)

CI / coverage

CI / integration (ozone)

HDDS-7614. Add subscription mechanism to ContainerReplicaPendingOps (#4064)

CI / coverage

CI / integration (ozone)

HDDS-7580. Add option to show key count in DBScanner. (#4033)

HDDS-7572. Use keyManager and trustManager provided by keyStoreFactory in datanode grpc services (#4032)

HDDS-7617. Mark testECContainerRecoveryWithTimedOutRecovery as flaky

HDDS-7587. Update NOTICE and LICENSE in license/bin/ (#4039) * update NOTICE and LICENSE in license/bin/

CI / acceptance (unsecure)

CI / coverage

HDDS-7603. Enable Erasure coding and encryption flag on FileStatus for ofs (#4060)

HDDS-7265. ScatterRackPolicy for Ratis pipeline provider container placement (#4002)

CI / coverage

CI / integration (flaky)

HDDS-7502. Recon: Show number of open containers on the Overview page (#4043)

CI / basic (unit)

CI / coverage

HDDS-7615. Import Guava classes directly, not from hadoop-thirdparty (#4062)

HDDS-7492. Extend Placement Policy Interface to select mis-replicated replicas to copy (#4006)

HDDS-7597. Clarify SCM admin access denied message (#4056)

CI / coverage

CI / integration (client)

CI / integration (flaky)

HDDS-7464. Container Report at SCM is not coming separately for ICR and FCR in prometheus endpoint (#4035)

CI / acceptance (misc)

CI / coverage

HDDS-7550. Recon: UI sorting not functioning as expected (#4009)

HDDS-7599. Bump commons-net from 3.6 to 3.9.0 (#4046)

CI / coverage

CI / integration (ozone)

HDDS-7526. Avoid overwriting replication config on existing bucket when quota is set (#4013)

CI / acceptance (secure)

CI / coverage

CI / integration (ozone)

HDDS-7472. EC: Fix NSSummaryEndpoint#getDiskUsage for EC keys (#3987)

HDDS-5704. Ozone URI syntax description in help content needs to mention about ozone service id (#3862)

CI / acceptance (secure)

CI / coverage

HDDS-7555. Upgrade Ratis to 2.4.2-8b8bdda-SNAPSHOT. (#4028)

HDDS-7541. FSO recursive delete directory with hierarchy takes much time for cleanup (#4008)

CI / coverage

CI / integration (filesystem)

HDDS-7581. Fix update-jar-report for snapshot (#4034)

CI / basic (unit)

CI / coverage

HDDS-7253. Fix exception when '/' in key name (#4038)

CI / coverage

CI / integration (om)

HDDS-7579. Use Netty 4.1.77 for consistency (#4031)

CI / coverage

CI / integration (filesystem)

HDDS-7562. Suppress warning about long filenames in tar (#4017)

HDDS-7563. Add a handler for under replicated Ratis containers in RM (#4025)

CI / coverage

CI / integration (client)

CI / integration (filesystem)

CI / integration (om)

HDDS-7497. Fix mkdir does not update bucket's usedNamespace (#3969)

CI / acceptance (misc)

CI / coverage

CI / integration (hdds)

HDDS-7567. Invalid entries in LICENSE (#4020) * HDDS-7567. Invalid entries in LICENSE

HDDS-7575. Correct showing of RATIS-THREE icon in Recon UI (#4026)

HDDS-7540. Let reusable workflow inherit secrets (#4012)

CI / basic (unit)

CI / coverage

HDDS-7568. Bump copyright year in NOTICE (#4018)

CI / coverage

HDDS-7394. OM RPC FairCallQueue decay decision metrics list caller username in the metric (#3878)

CI / coverage

HDDS-7510. Recon: Return number of open containers in `/clusterState` endpoint (#3989)

CI / basic (unit)

CI / coverage

HDDS-7561. Improve setquota, clrquota CLI usage (#4016)

CI / coverage

HDDS-6615. EC: Improve write performance by pipelining encode and flush (#3994)

CI / coverage

HDDS-7554. Recon UI should show DORMANT in pipeline status filter (#4010)

CI / coverage

HDDS-7540. Separate scheduled CI from push/PR workflows (#4004)

CI / basic (unit)

CI / coverage

HDDS-7500. Ozone recon server Memory Optimization. (#3974)

HDDS-7500. Ozone recon server Memory Optimization. (#3974)

integration (flaky)

HDDS-7536. Remove unused dependency declarations (#4001) Reviewed-by: Wei-Chiu Chuang <weichiu@apache.org> Reviewed-by...

acceptance (misc)

basic (unit) o.a.h.hdds.scm.container.replication.TestReplicationManager (timeout?)

integration (ozone) o.a.h.ozone.parser.TestOzoneHARatisLogParser.testRatisLogParsing

HDDS-7486. Support KeyStoreFactory which supports keyManager and trustManager reload (#3959)

integration (filesystem) o.a.h.fs.ozone.TestRootedOzoneFileSystem.testTrash

HDDS-7289. Bump protobuf-java from 3.19.2 to 3.19.6 (#4003)

HDDS-7535. Eliminate duplicated config in LegacyReplicationManager (#4000)

HDDS-7535. Eliminate duplicated config in LegacyReplicationManager (#4000)

integration (flaky)

HDDS-7449. Avoid overwriting bucket encryption properties when quota/replication config are set on an existing bucket (#...

HDDS-7449. Avoid overwriting bucket encryption properties when quota/replication config are set on an existing bucket (#...

HDDS-7538. Remove unused OmUtils#getMD5Digest (#3996)

HDDS-7538. Remove unused OmUtils#getMD5Digest (#3996)

acceptance (misc)

HDDS-7534. Intermittent failure in TestKeyDeletingService#checkDeletionForEmptyKey (#3998)

HDDS-7534. Intermittent failure in TestKeyDeletingService#checkDeletionForEmptyKey (#3998)

HDDS-7534. Intermittent failure in TestKeyDeletingService#checkDeletionForEmptyKey (#3998)

HDDS-7534. Intermittent failure in TestKeyDeletingService#checkDeletionForEmptyKey (#3998)

HDDS-7534. Intermittent failure in TestKeyDeletingService#checkDeletionForEmptyKey (#3998)

integration (client) o.a.h.ozone.client.rpc.TestFailureHandlingByClient (timeout?)

HDDS-7534. Intermittent failure in TestKeyDeletingService#checkDeletionForEmptyKey (#3998)

HDDS-7353. Cleanup of unused code in SCM (#3905)

HDDS-7353. Cleanup of unused code in SCM (#3905)

basic (unit) o.a.h.ozone.security.acl.TestParentAcl (timeout?)

HDDS-7481. Set quota with reduced size than actual used do not fail (#3978)

integration (ozone) o.a.h.ozone.container.TestECContainerRecovery.testECContainerRecoveryWithTimedOutRecovery

HDDS-7187. EC: Retry failed writes before rewrite to a new block group (#3977)

acceptance (misc)

HDDS-7187. EC: Retry failed writes before rewrite to a new block group (#3977)

HDDS-7532. EC: ReplicationManager - remove calls to ECHealthCheck from under and over replication processing (#3995)

HDDS-7528. EC: ReplicationManager - refactor logic to send datanode commands into a central place (#3990)

integration (om)

HDDS-7528. EC: ReplicationManager - refactor logic to send datanode commands into a central place (#3990)

integration (flaky)

HDDS-7092. EC: Offline Recovery with simultaneous Over Replication & Under Replication (#3984)

HDDS-7462. EC: Fix Reconstruction Issue with StaleRecoveringContainerScrubbingService (#3939)

HDDS-7518. Fix intermittent failure in ozonesecure replication test (#3986)

basic (unit) o.a.h.ozone.om.service.TestKeyDeletingService (timeout?)

HDDS-7518. Fix intermittent failure in ozonesecure replication test (#3986)

HDDS-7518. Fix intermittent failure in ozonesecure replication test (#3986)

basic (unit) o.a.h.ozone.om.ratis.TestOzoneManagerDoubleBufferWithOMResponse (timeout?)

HDDS-5526. ContainerBalancer#checkConditionsForBalancing pre-emptively checks iteration limits. (#3895)

HDDS-7280. New test addition to TestOMBucketCreateRequestWithFSO (#3794)

HDDS-7280. New test addition to TestOMBucketCreateRequestWithFSO (#3794)

acceptance (HA)

acceptance (secure)

HDDS-7476. SCM root CA stored under hdds.datanode.dir if ozone.metadata.dirs is not specified (#3948)

integration (flaky)

HDDS-4565. [FSO]Delete : quotaReleased on directory deletion should consider all sub paths (#3973)

acceptance (secure)

HDDS-4565. [FSO]Delete : quotaReleased on directory deletion should consider all sub paths (#3973)

acceptance (secure)

HDDS-7498. Add permission check when `--user` is specified in `ozone sh volume list` (#3971)

acceptance (secure)

HDDS-7498. Add permission check when `--user` is specified in `ozone sh volume list` (#3971)

acceptance (secure)

HDDS-7498. Add permission check when `--user` is specified in `ozone sh volume list` (#3971)

acceptance (secure)

HDDS-7498. Add permission check when `--user` is specified in `ozone sh volume list` (#3971)

acceptance (secure)

HDDS-7498. Add permission check when `--user` is specified in `ozone sh volume list` (#3971)

acceptance (secure)

HDDS-7498. Add permission check when `--user` is specified in `ozone sh volume list` (#3971)

acceptance (secure)

basic (unit) o.a.h.ozone.om.service.TestKeyDeletingService (timeout?)

HDDS-7346. Cannot set bucket args when the bucket has quota set (#3975)

integration (flaky)

HDDS-7346. Cannot set bucket args when the bucket has quota set (#3975)

acceptance (secure)

integration (filesystem) o.a.h.fs.ozone.TestRootedOzoneFileSystem.testTrash

integration (hdds)

HDDS-7470. [Quota] bucket is created crossing quota makes OM crash and unable to start (#3960)

acceptance (secure)

integration (filesystem) o.a.h.fs.ozone.TestOzoneFileSystem.testTrash

HDDS-7260. dfs -du should return correct disk space consumed by all replicas (#3810)

acceptance (secure)

integration (filesystem) o.a.h.fs.ozone.TestOzoneFileSystemWithFSO (timeout?)

HDDS-7474. Recon: Add count to containers page tab label (#3951)

basic (unit) o.a.h.hdds.scm.container.replication.TestReplicationManager (timeout?)

HDDS-7245. Recon: Add button to trigger OM DB Sync (Frontend) (#3929)

HDDS-7245. Recon: Add button to trigger OM DB Sync (Frontend) (#3929)

integration (om)

HDDS-4402. Recon dashboard page does not load until missing containers API returns data. (#3968)

HDDS-7488. EC: ReplicationManager: Move Mis-Replicated into a separate unhealthy state (#3956)

integration (filesystem) o.a.h.fs.ozone.TestOzoneFileSystemWithFSO (timeout?)

HDDS-7487. Support fine grained certificate lifetime for efficient test. (#3954)

HDDS-7487. Support fine grained certificate lifetime for efficient test. (#3954)

HDDS-7095. allow on demand scanning for containers (#3788)

basic (unit) o.a.h.ozone.security.acl.TestParentAcl (timeout?)

HDDS-6971. EC: Add EC block checksum computer. (#3790)

HDDS-6971. EC: Add EC block checksum computer. (#3790)

basic (unit) o.a.h.hdds.scm.container.replication.TestReplicationManager (timeout?)

HDDS-7101. EC: ReplicationManager - handle UNHEALTHY replicas (#3962)

HDDS-7101. EC: ReplicationManager - handle UNHEALTHY replicas (#3962)

HDDS-7255. Add metrics for container reports events (#3936)

acceptance (misc)

HDDS-7490. fix metaTable error (#3961)

HDDS-7490. fix metaTable error (#3961)

HDDS-7468. Recon: clusterState API Changes for adding missingContainerCount (#3952)

integration (om)

HDDS-7485. Bump commons-codec to 1.15 (#3955)

HDDS-7485. Bump commons-codec to 1.15 (#3955)

HDDS-7475. Remove outdated Hadoop dependencies (#3950)

integration (om)

HDDS-7475. Remove outdated Hadoop dependencies (#3950)

HDDS-7475. Remove outdated Hadoop dependencies (#3950)

basic (unit) o.a.h.ozone.security.TestOzoneDelegationTokenSecretManager (timeout?)

HDDS-7471. EC: Notify ReplicationManager when a heartbeat updates datanode command counts (#3945)

dependency

integration (hdds)

HDDS-7471. EC: Notify ReplicationManager when a heartbeat updates datanode command counts (#3945)

HDDS-7471. EC: Notify ReplicationManager when a heartbeat updates datanode command counts (#3945)

HDDS-7471. EC: Notify ReplicationManager when a heartbeat updates datanode command counts (#3945)

HDDS-7471. EC: Notify ReplicationManager when a heartbeat updates datanode command counts (#3945)

HDDS-7471. EC: Notify ReplicationManager when a heartbeat updates datanode command counts (#3945)

HDDS-7471. EC: Notify ReplicationManager when a heartbeat updates datanode command counts (#3945)

acceptance (misc)

integration (ozone) o.a.h.ozone.parser.TestOzoneHARatisLogParser.testRatisLogParsing

HDDS-7446. Cleanup possibly onDisk unreferenced blocks (#3923)

integration (client) o.a.h.ozone.client.rpc.TestFailureHandlingByClient (timeout?)

HDDS-7469. Recon: Add more information to Open Containers column on on the Datanodes page. (#3944)

HDDS-7469. Recon: Add more information to Open Containers column on on the Datanodes page. (#3944)

HDDS-4385. Search function using container ID on Recon Missing Container (#3917)

kubernetes

HDDS-7408. Recon: Refactor container status page (#3916)

HDDS-7456 Recon: Refreshed at not working on Pipeline and DataNode page (#3933)

integration (client) o.a.h.ozone.client.rpc.TestBlockOutputStreamFlushDelay (timeout?)

HDDS-7323. Recon: Auto refresh toggle is switched back when visiting new site (#3868)

HDDS-7360. Investigate TestRootedOzoneFileSystem test cases. (#3928)

HDDS-7360. Investigate TestRootedOzoneFileSystem test cases. (#3928)

integration (hdds)

integration (ozone) o.a.h.ozone.parser.TestOzoneHARatisLogParser.testRatisLogParsing

HDDS-7314. Recon graceful shutdown while closing RocksDB handle. (#3931)

HDDS-7440. Delete package-info class for org.apache.hadoop.io.erasurecode.rawcoder to avoid conflict with Hadoop (#3925)

HDDS-7440. Delete package-info class for org.apache.hadoop.io.erasurecode.rawcoder to avoid conflict with Hadoop (#3925)

integration (ozone) o.a.h.ozone.parser.TestOzoneHARatisLogParser.testRatisLogParsing

HDDS-7453. Check certificate expiration at service startup, renew if necessary. (#3930)

HDDS-7453. Check certificate expiration at service startup, renew if necessary. (#3930)

HDDS-2642. Expose decommission / maintenance metrics via JMX (#3781) * Expose decommission / maintenance metrics via JM...

HDDS-5112. Recon Insights page does not list buckets when only one volume is present. (#3907)

HDDS-5112. Recon Insights page does not list buckets when only one volume is present. (#3907)

basic (unit) o.a.h.ozone.security.TestOzoneDelegationTokenSecretManager (timeout?)

HDDS-6896. EC: ReplicationManager - Add relevant metrics to the various ReplicationManager classes (#3909)

HDDS-6896. EC: ReplicationManager - Add relevant metrics to the various ReplicationManager classes (#3909)

basic (unit) o.a.h.ozone.security.acl.TestParentAcl.testKeyAcl

integration (flaky)

integration (hdds)

HDDS-7326. Intermittent timeout in TestECContainerRecovery.testContainerRecoveryOverReplicationProcessing (#3941)

integration (hdds)

HDDS-7451. Add UT of SyncDataFromOM for SequenceNumberNotFoundException (#3927)

Upgrade RocksDB to 7.7.3 (#3924)

integration (hdds)

Upgrade RocksDB to 7.7.3 (#3924)

HDDS-7460. Bump snakeyaml from 1.32 to 1.33 (#3935)

integration (client) o.a.h.ozone.client.rpc.TestBlockOutputStreamFlushDelay (timeout?)

integration (flaky)

integration (ozone) o.a.h.ozone.container.TestECContainerRecovery.testContainerRecoveryOverReplicationProcessing

HDDS-7460. Bump snakeyaml from 1.32 to 1.33 (#3935)

HDDS-7460. Bump snakeyaml from 1.32 to 1.33 (#3935)

HDDS-7460. Bump snakeyaml from 1.32 to 1.33 (#3935)

HDDS-7460. Bump snakeyaml from 1.32 to 1.33 (#3935)

acceptance (unsecure)

HDDS-3419. Throw exception with correct code when available data nodes are not sufficient (#3847)

acceptance (unsecure)

integration (ozone) o.a.h.ozone.container.TestECContainerRecovery.testContainerRecoveryOverReplicationProcessing

HDDS-3419. Throw exception with correct code when available data nodes are not sufficient (#3847)

HDDS-3419. Throw exception with correct code when available data nodes are not sufficient (#3847)

basic (unit) o.a.h.ozone.om.service.TestKeyDeletingService (timeout?)

integration (om)

integration (ozone) o.a.h.ozone.container.TestECContainerRecovery.testContainerRecoveryOverReplicationProcessing

HDDS-3419. Throw exception with correct code when available data nodes are not sufficient (#3847)

acceptance (secure)

HDDS-7362. Bring back the mechanism to share LRU cache between RocksDB in datanodes (#3921)

HDDS-7419. Integrate the GetKeyInfo API to OFS (#3912) Reviewed-by: Wei-Chiu Chuang <weichiu@apache.org> Reviewed-by: ...

HDDS-7324. S3G: Avoid calling getS3VolumeContext by using GetGeyInfo API. (#3911)

dependency

integration (ozone) o.a.h.ozone.container.TestECContainerRecovery.testContainerRecoveryOverReplicationProcessing

HDDS-7324. S3G: Avoid calling getS3VolumeContext by using GetGeyInfo API. (#3911)

integration (flaky)

HDDS-5866. Discrepancy in Trash directory in ofs vs o3fs. (#3906) * HDDS-5866.Discrepancy in Trash directory in ofs vs ...

integration (ozone) o.a.h.ozone.container.TestECContainerRecovery.testContainerRecoveryOverReplicationProcessing

HDDS-7423. DB Scanner should allow iteration from specific key (#3893) * HDDS-7423. DB Scanner should allow iteration f...

HDDS-7423. DB Scanner should allow iteration from specific key (#3893) * HDDS-7423. DB Scanner should allow iteration f...

HDDS-6757. Test "size.leaving.source.max" limit in ContainerBalancer (#3904)

integration (ozone) o.a.h.ozone.container.TestECContainerRecovery.testContainerRecoveryOverReplicationProcessing

HDDS-7090. EC: delete empty closed EC container (#3660)

HDDS-7025. Add cache metrics in OM. (#3865)

basic (unit) o.a.h.ozone.security.acl.TestParentAcl.testKeyAcl

HDDS-7025. Add cache metrics in OM. (#3865)

HDDS-7435. ContainerOperationClient cleanup (#3910)

HDDS-7435. ContainerOperationClient cleanup (#3910)

HDDS-7435. ContainerOperationClient cleanup (#3910)

acceptance (HA)

HDDS-7435. ContainerOperationClient cleanup (#3910)

HDDS-6926. Add support for shaded protobufs used by hadoop-client/spark. (#3915)

HDDS-7447. Leak of TableIterator in DirectoryDeletingService. (#3922)

HDDS-7320. Enable Container SchemaV3 by default. (#3841) * HDDS-7320. Enable Container SchemaV3 by default.

HDDS-7429. Remove Tag from SCMMetadataStoreMetrics (#3897)

integration (client) o.a.h.ozone.client.rpc.TestFailureHandlingByClient (timeout?)

HDDS-7429. Remove Tag from SCMMetadataStoreMetrics (#3897)

basic (unit) o.a.h.ozone.om.service.TestKeyDeletingService (timeout?)

HDDS-7363. Changes to Ozone CLI to validate if the jars in classpath files are present on an install (#3864)

HDDS-7290. provide a config to increase the list batch size in OzoneFileSystem (#3853)

HDDS-7244. Fix multiple reports queued up from same DN and using up heap (#3783)

HDDS-7244. Fix multiple reports queued up from same DN and using up heap (#3783)

integration (ozone) o.a.h.ozone.container.TestECContainerRecovery.testContainerRecoveryOverReplicationProcessing

integration (scm)

HDDS-7146. Recon: Add button to trigger OM DB Sync (Backend) (#3821)

integration (client) o.a.h.ozone.client.rpc.TestOzoneRpcClientWithRatis.

HDDS-7146. Recon: Add button to trigger OM DB Sync (Backend) (#3821)

HDDS-7146. Recon: Add button to trigger OM DB Sync (Backend) (#3821)

integration (ozone) o.a.h.ozone.container.TestECContainerRecovery.testContainerRecoveryOverReplicationProcessing

HDDS-7146. Recon: Add button to trigger OM DB Sync (Backend) (#3821)

integration (client) o.a.h.ozone.client.rpc.TestFailureHandlingByClient (timeout?)

HDDS-7146. Recon: Add button to trigger OM DB Sync (Backend) (#3821)

HDDS-7146. Recon: Add button to trigger OM DB Sync (Backend) (#3821)

HDDS-7231. Integrate the GetKeyInfo API to key read flows (#3800)

HDDS-7384. EC: ReplicationManager - implement deleting container handler (#3881)

HDDS-7384. EC: ReplicationManager - implement deleting container handler (#3881)

HDDS-7361. Add general metrics for queues in Datanode (#3863)

integration (ozone) o.a.h.ozone.container.TestECContainerRecovery.testContainerRecoveryOverReplicationProcessing

HDDS-7432. Move command summary into Commands object in CommandQueue (#3901)

integration (client) o.a.h.ozone.client.rpc.TestFailureHandlingByClient.testBlockWritesWithDnFailures

HDDS-7420. Bump Spring framework from 5.2.20 to 5.3.23 (#3902)

acceptance (misc)

HDDS-7421. Respect OZONE_LOGLEVEL and OZONE_ROOT_LOGGER for CLI commands (#3892) * [wip] get rid of ozone-shell.log, su...

integration (client) o.a.h.ozone.client.rpc.TestOzoneRpcClient.

HDDS-7421. Respect OZONE_LOGLEVEL and OZONE_ROOT_LOGGER for CLI commands (#3892) * [wip] get rid of ozone-shell.log, su...

integration (ozone)

HDDS-7316. Print stacktrace to identify the location of RocksObject leaks. (#3827)

HDDS-1157. TestOzoneContainerWithTLS is failing with SSLHandshakeException (#3888)

HDDS-7406. Remove unused the exception & improve debug log in KeyDeletingService (#3880)

HDDS-7406. Remove unused the exception & improve debug log in KeyDeletingService (#3880)

kubernetes

HDDS-7328. Improve Deletion of FSO Paths (#3844)

kubernetes

HDDS-7370. Add pending commands in SCM to Datanode command count (#3867)

basic (unit) o.a.h.ozone.om.service.TestKeyDeletingService (timeout?)

HDDS-7220. SCM should use sub-ca certificate for token signature without HA enabled (#3752)

HDDS-7424. Bump jetty to 9.4.49.v20220914 (#3894)

HDDS-7407. EC: Block allocation should not be stripped across the EC group (#3882)

HDDS-7402. Adapt CommandQueue to track the count of each queued command type (#3891)

integration (flaky)

HDDS-7422. Bump woodstox-core from 5.0.3 to 5.4.0 (#3886)

integration (ozone) o.a.h.ozone.container.common.statemachine.commandhandler.TestBlockDeletion (timeout?)

HDDS-7422. Bump woodstox-core from 5.0.3 to 5.4.0 (#3886)

integration (om)

HDDS-7349. Flaky integration test have memory leak for RatisDropwizardExports (#3858)

integration (flaky)

HDDS-7342. Move encryption-related code from MultipartCryptoKeyInputStream to OzoneCryptoInputStream (#3852)

HDDS-7342. Move encryption-related code from MultipartCryptoKeyInputStream to OzoneCryptoInputStream (#3852)

HDDS-7413. Fix logging while marking container state unhealthy (#3887)

Revert "HDDS-7253. Fix exception when '/' in key name (#3774)" This reverts commit b9a47f6bbf72605d5391cafc8d382190f822...

basic (unit) o.a.h.hdds.scm.container.replication.TestReplicationManager (timeout?)

HDDS-7396. Force close non-RATIS containers in ReplicationManager (#3877)

HDDS-7121. Support namespace summaries (du, dist & counts) for legacy FS buckets (#3746)

HDDS-7121. Support namespace summaries (du, dist & counts) for legacy FS buckets (#3746)

integration (client) o.a.h.ozone.client.rpc.TestOzoneRpcClientWithRatis.

HDDS-7258. Cleanup the allocated but uncommitted blocks (#3778)

integration (filesystem) o.a.h.fs.ozone.contract.ITestOzoneContractMkdir (timeout?)

HDDS-7381. Cleanup of VolumeManagerImpl (#3873)

HDDS-7253. Fix exception when '/' in key name (#3774)

HDDS-7253. Fix exception when '/' in key name (#3774)

HDDS-7182. Add property to control RocksDB max open files (#3843)

integration (ozone) o.a.h.ozone.container.TestECContainerRecovery.testContainerRecoveryOverReplicationProcessing

HDDS-7284. JVM crash for rocksdb for read/write after close (#3801)

integration (client) o.a.h.ozone.client.rpc.TestFailureHandlingByClient (timeout?)

kubernetes

HDDS-7368. [Multi-Tenant] Add Volume Existence check in preExecute for OMTenantCreateRequest (#3869)

HDDS-7368. [Multi-Tenant] Add Volume Existence check in preExecute for OMTenantCreateRequest (#3869)

kubernetes

HDDS-7403. README Security Improvement (#3879) Co-authored-by: SaketaChalamchala <schalamchala@cloudera.com>

HDDS-7199. Implement new mix workload Read/Write Freon command (#3872)

acceptance (MR)

acceptance (misc)

kubernetes

HDDS-7199. Implement new mix workload Read/Write Freon command (#3872)

HDDS-7199. Implement new mix workload Read/Write Freon command (#3872)

acceptance (misc)

basic (unit) o.a.h.hdds.scm.container.replication.TestReplicationManager (timeout?)

HDDS-7199. Implement new mix workload Read/Write Freon command (#3872)

integration (client) o.a.h.ozone.client.rpc.TestBlockOutputStreamWithFailuresFlushDelay (timeout?)

integration (flaky)

HDDS-7199. Implement new mix workload Read/Write Freon command (#3872)

HDDS-7248. Recon: Expand the container status page to show all unhealthy container states (#3837)

HDDS-7248. Recon: Expand the container status page to show all unhealthy container states (#3837)

integration (filesystem) o.a.h.fs.ozone.TestOzoneFileSystem.testTrash

integration (ozone) o.a.h.ozone.container.TestECContainerRecovery.testContainerRecoveryOverReplicationProcessing

HDDS-7248. Recon: Expand the container status page to show all unhealthy container states (#3837)

integration (om)

HDDS-7248. Recon: Expand the container status page to show all unhealthy container states (#3837)

HDDS-7141. Recon: Improve Disk Usage Page (#3789)

HDDS-7369. Fix wrong order of command arguments in Nonrolling-Upgrade.md (#3866)

kubernetes

HDDS-7369. Fix wrong order of command arguments in Nonrolling-Upgrade.md (#3866)

HDDS-6210. EC: Add EC metrics (#3851)

HDDS-7355. non-primordial scm fail to get signed cert from primordial SCM when converting an unsecure cluster to secure ...

HDDS-7355. non-primordial scm fail to get signed cert from primordial SCM when converting an unsecure cluster to secure ...

integration (ozone) o.a.h.ozone.shell.TestResetDeletedBlockRetryCountShell (timeout?)

HDDS-7356. Update SCM-HA.zh.md to match the English version (#3861)

HDDS-6930. SCM,OM,RECON should not print ERROR and exit with code 1 on successful shutdown (#3848)

Revert "HDDS-7199. Implement new mix workload Read/Write Freon command which meets specific test requirements (#3754)" ...

integration (flaky)

HDDS-7354. SchemaV3 blockData not deleted in table (#3860)

acceptance (HA)

acceptance (unsecure)

basic (checkstyle) ...-ozone/tools/src/main/java/org/apache/hadoop/ozone/freon/RangeKeysGenerator.java (timeout?)

basic (checkstyle) 26: Unused import - o.a.h.ozone.client.OzoneBucket. (timeout?)

basic (checkstyle) 171: Line is longer than 80 characters (found 109). (timeout?)

basic (checkstyle) ...ools/src/main/java/org/apache/hadoop/ozone/freon/OzoneClientKeyReadWriteOps.java (timeout?)

basic (checkstyle) 24: Unused import - o.a.h.ozone.client.OzoneBucket. (timeout?)

basic (checkstyle) 192: Line is longer than 80 characters (found 110). (timeout?)

basic (checkstyle) 196: 'try' child has incorrect indentation level 9, expected level should be 8. (timeout?)

basic (checkstyle) 206: Line is longer than 80 characters (found 125). (timeout?)

basic (checkstyle) 220: ',' is not followed by whitespace. (timeout?)

basic (findbugs) ....io.OzoneInputStream.read(byte[]) At OzoneClientKeyReadWriteOps.java:[line 196] (timeout?)

HDDS-7199. Implement new mix workload Read/Write Freon command which meets specific test requirements (#3754)

acceptance (HA)

acceptance (unsecure)

basic (checkstyle) ...-ozone/tools/src/main/java/org/apache/hadoop/ozone/freon/RangeKeysGenerator.java (timeout?)

basic (checkstyle) 26: Unused import - o.a.h.ozone.client.OzoneBucket. (timeout?)

basic (checkstyle) 171: Line is longer than 80 characters (found 109). (timeout?)

basic (checkstyle) ...ools/src/main/java/org/apache/hadoop/ozone/freon/OzoneClientKeyReadWriteOps.java (timeout?)

basic (checkstyle) 24: Unused import - o.a.h.ozone.client.OzoneBucket. (timeout?)

basic (checkstyle) 192: Line is longer than 80 characters (found 110). (timeout?)

basic (checkstyle) 196: 'try' child has incorrect indentation level 9, expected level should be 8. (timeout?)

basic (checkstyle) 206: Line is longer than 80 characters (found 125). (timeout?)

basic (checkstyle) 220: ',' is not followed by whitespace. (timeout?)

basic (findbugs) ....io.OzoneInputStream.read(byte[]) At OzoneClientKeyReadWriteOps.java:[line 196] (timeout?)

integration (flaky)

integration (ozone) o.a.h.ozone.container.TestECContainerRecovery.testContainerRecoveryOverReplicationProcessing

HDDS-7199. Implement new mix workload Read/Write Freon command which meets specific test requirements (#3754)

acceptance (HA)

basic (checkstyle) ...-ozone/tools/src/main/java/org/apache/hadoop/ozone/freon/RangeKeysGenerator.java (timeout?)

basic (checkstyle) 26: Unused import - o.a.h.ozone.client.OzoneBucket. (timeout?)

basic (checkstyle) 171: Line is longer than 80 characters (found 109). (timeout?)

basic (checkstyle) ...ools/src/main/java/org/apache/hadoop/ozone/freon/OzoneClientKeyReadWriteOps.java (timeout?)

basic (checkstyle) 24: Unused import - o.a.h.ozone.client.OzoneBucket. (timeout?)

basic (checkstyle) 192: Line is longer than 80 characters (found 110). (timeout?)

basic (checkstyle) 196: 'try' child has incorrect indentation level 9, expected level should be 8. (timeout?)

basic (checkstyle) 206: Line is longer than 80 characters (found 125). (timeout?)

basic (checkstyle) 220: ',' is not followed by whitespace. (timeout?)

basic (findbugs) ....io.OzoneInputStream.read(byte[]) At OzoneClientKeyReadWriteOps.java:[line 196] (timeout?)

HDDS-7351. Use jackson-bom to ensure consistent Jackson version (#3856)

HDDS-7305. Fix Hadoop imports (#3822)

HDDS-7305. Fix Hadoop imports (#3822)

integration (om)

HDDS-7341. EC: Close pipelines with unregistered nodes (#3850)

HDDS-7058. EC: ReplicationManager - Implement ratis container replication check handler (#3802)

basic (unit) o.a.h.ozone.TestHddsDatanodeService (timeout?)

HDDS-7352. OM log flooded by AWSV4AuthValidator (#3857)

acceptance (misc)

kubernetes

HDDS-7149. Update ratis version to 2.4.0 and thirdparty version to 1.0.2. (#3855)

integration (ozone) o.a.h.ozone.container.TestECContainerRecovery.testContainerRecoveryOverReplicationProcessing

HDDS-7254. Document that moving SCM from non-HA to HA is currently unsupported. (#3846)

HDDS-7254. Document that moving SCM from non-HA to HA is currently unsupported. (#3846)

integration (om)

HDDS-6893. EC: ReplicationManager - move the empty container handling into RM from Legacy (#3831)

HDDS-7340. Bump jackson-databind to 2.13.4.2 (#3845)

HDDS-7340. Bump jackson-databind to 2.13.4.2 (#3845)

integration (filesystem)

integration (om)

HDDS-7214. Continuous start & stop can have hanging threads in stopping (#3782)

integration (flaky)

integration (om)

HDDS-7343. Do not log exception on file not found in getFileStatus() (#3849)

basic (unit) o.a.h.hdds.scm.container.replication.TestReplicationManager (timeout?)

integration (om)

HDDS-7337. Replace set-output in Github Actions workflow (#3839)

HDDS-7337. Replace set-output in Github Actions workflow (#3839)

acceptance (HA)

integration (flaky)

HDDS-7337. Replace set-output in Github Actions workflow (#3839)

acceptance (unsecure)

HDDS-7261. Add container location cache metrics. (#3829)

HDDS-7261. Add container location cache metrics. (#3829)

integration (client) o.a.h.ozone.client.rpc.read.TestKeyInputStream.testNonReplicationReads

HDDS-7261. Add container location cache metrics. (#3829)

HDDS-7330. Cleanup of BucketManagerImpl (#3838)

HDDS-7330. Cleanup of BucketManagerImpl (#3838)

HDDS-7330. Cleanup of BucketManagerImpl (#3838)

HDDS-7303. EC: ECBlockReconstructedStripeInputStream should set initialized only at the end of init() (#3816)

integration (flaky)

HDDS-7269. Remove fair lock configuration for container state management flows. (#3815)

integration (client) o.a.h.ozone.client.rpc.TestFailureHandlingByClient (timeout?)

integration (filesystem) o.a.h.fs.ozone.TestOzoneFileSystem (timeout?)

HDDS-7269. Remove fair lock configuration for container state management flows. (#3815)

integration (om)

integration (ozone) o.a.h.ozone.container.TestECContainerRecovery.testContainerRecoveryOverReplicationProcessing

HDDS-7300. Race condition between full data scan and block deletion (#3811)

integration (ozone) o.a.h.ozone.parser.TestOzoneHARatisLogParser.testRatisLogParsing

HDDS-7300. Race condition between full data scan and block deletion (#3811)

HDDS-7322. Remove unused dependencies hsqldb and jettison (#3834)

kubernetes

HDDS-7322. Remove unused dependencies hsqldb and jettison (#3834)

integration (ozone) o.a.h.ozone.parser.TestOzoneHARatisLogParser.testRatisLogParsing

HDDS-7308. Fix config example syntax highlight in OM HA (#3833)

HDDS-7270. Fix bug in checking healthy replica placement policy check in EC underReplication handler (#3828)

HDDS-7270. Fix bug in checking healthy replica placement policy check in EC underReplication handler (#3828)

integration (flaky)

integration (ozone) o.a.h.ozone.container.TestECContainerRecovery.testContainerRecoveryOverReplicationProcessing

HDDS-7291. Fixing exception handling in case of non positive replica index (#3806)

integration (flaky)

HDDS-7308 Removed cluster2 from serviceIds (#3819)

integration (flaky)

HDDS-7315 SCM order of close of dbstore and other services (#3830)

HDDS-6946. Bump Hadoop to 3.3.4 (#3557)

HDDS-6946. Bump Hadoop to 3.3.4 (#3557)

basic (unit) o.a.h.ozone.security.acl.TestParentAcl (timeout?)

integration (om)

HDDS-7271. Ozone Integration test shows memory leak (graceful shutdown cleanup) (#3826)

HDDS-7313. Update github actions for Node16 (#3825)

HDDS-7313. Update github actions for Node16 (#3825)

HDDS-7088. OM incorrectly detects SCM Ratis Group ID when OM and SCM are colocated with same Ratis storage directory. (#...

HDDS-6440. Handle custom metadata (x-amz-meta) during put-object through S3 API. (#3728)

HDDS-7236. Enable Recon SCM DB bootstrap by default. (#3823)

integration (flaky)

HDDS-7236. Enable Recon SCM DB bootstrap by default. (#3823)

acceptance (secure)

integration (flaky)

Revert "HDDS-7271. Ozone Integration test shows memory leak (graceful shutdown cleanup) (#3787)" This reverts commit af...

integration (client) o.a.h.ozone.client.rpc.TestBlockOutputStreamWithFailuresFlushDelay (timeout?)

integration (flaky)

integration (ozone) o.a.h.ozone.parser.TestOzoneHARatisLogParser.testRatisLogParsing

HDDS-7271. Ozone Integration test shows memory leak (graceful shutdown cleanup) (#3787)

integration (ozone) o.a.h.ozone.dn.ratis.TestDnRatisLogParser.testRatisLogParsing

integration (ozone) o.a.h.ozone.container.common.statemachine.commandhandler.TestBlockDeletion.testContainerStatisticsAfterDelete

HDDS-7271. Ozone Integration test shows memory leak (graceful shutdown cleanup) (#3787)

integration (ozone) o.a.h.ozone.dn.ratis.TestDnRatisLogParser.testRatisLogParsing

integration (ozone) o.a.h.ozone.container.common.statemachine.commandhandler.TestBlockDeletion.testContainerStatisticsAfterDelete

HDDS-7304. EC: EC Decode can fail when byteBuffer from elastic pool is larger than chunksize (#3817)

integration (flaky)

HDDS-7230. Implement GetKeyInfo API (#3780)

integration (filesystem) o.a.h.fs.ozone.TestOzoneFileSystemWithFSO (timeout?)

integration (flaky)

HDDS-7299. Migrate simple tests in hdds-container-service to JUnit5 (#3813)

integration (flaky)

HDDS-7299. Migrate simple tests in hdds-container-service to JUnit5 (#3813)

HDDS-6664. Implements getUri in TrashOzoneFileSystem (#3795) * HDDS-6664. Implements getUri in TrashOzoneFileSystem ...

acceptance (HA)

HDDS-6664. Implements getUri in TrashOzoneFileSystem (#3795) * HDDS-6664. Implements getUri in TrashOzoneFileSystem ...

integration (flaky)

integration (ozone) o.a.h.ozone.TestStorageContainerManager (timeout?)

HDDS-7287. Send deleteBlocksRequest with correct retry count (#3799)

integration (om)

HDDS-7302. Fix inaccurate container block count caused by missing block (#3814)

integration (filesystem) o.a.h.fs.ozone.TestOzoneFileSystem.testTrash

HDDS-7294. Move ozone manager background services to a separate package (#3805)

HDDS-7294. Move ozone manager background services to a separate package (#3805)

acceptance (secure)

integration (filesystem) o.a.h.fs.ozone.TestOzoneFileSystem (timeout?)

HDDS-7294. Move ozone manager background services to a separate package (#3805)

HDDS-7286. Clean up ContainerManager (#3797)

kubernetes

HDDS-7293. Bump jackson2 to 2.13.4 (#3808)

integration (client) TestReadRetries (timeout?)

HDDS-7293. Bump jackson2 to 2.13.4 (#3808)

HDDS-7293. Bump jackson2 to 2.13.4 (#3808)

integration (flaky)

HDDS-7259. Fix uncounted blocksDeleted in BlockDeletingService (#3779)

HDDS-7208. Erasure coding and encryption are not flagged on FileStatus (#3768)

acceptance (HA)

integration (client) o.a.h.ozone.client.rpc.read.TestKeyInputStream.testNonReplicationReads

integration (ozone) o.a.h.ozone.container.ozoneimpl.TestOzoneContainer (timeout?)

HDDS-7208. Erasure coding and encryption are not flagged on FileStatus (#3768)

integration (ozone) o.a.h.ozone.parser.TestOzoneHARatisLogParser.testRatisLogParsing

HDDS-7217. OM logs wrong bucket layout (#3750) * bucket layout fix - unit test * cleanup * cleanup tests with cli...

HDDS-7217. OM logs wrong bucket layout (#3750) * bucket layout fix - unit test * cleanup * cleanup tests with cli...

integration (flaky)

HDDS-7211. Remove dead code from KeyManagerImpl (#3747)

acceptance (misc)

HDDS-7211. Remove dead code from KeyManagerImpl (#3747)

kubernetes

HDDS-7282. Add EstimatedKeyCount metrics for SCM DB (#3791)

HDDS-7282. Add EstimatedKeyCount metrics for SCM DB (#3791)

integration (client) TestKeyInputStream (timeout?)

integration (filesystem) o.a.h.fs.ozone.TestRootedOzoneFileSystemWithFSO.testDeleteVolumeAndBucket

HDDS-7250. Add HttpServer metrics (#3772)

integration (filesystem) o.a.h.fs.ozone.TestRootedOzoneFileSystemWithFSO.testDeleteVolumeAndBucket

HDDS-7250. Add HttpServer metrics (#3772)

basic (unit) o.a.h.ozone.security.acl.TestParentAcl (timeout?)

integration (flaky)

HDDS-7219. Remove not applicable info from ozone bucket list for links (#3777)

HDDS-7285. Fix concurrency issue in DeleteBlocksCommandHandler (#3796)

HDDS-7285. Fix concurrency issue in DeleteBlocksCommandHandler (#3796)

HDDS-7235. EOFException occurs when executing TPC-DS using o3fs (#3764)

HDDS-7283. Set coreSize equal to maxSize for threadPoolExecutor (#3792)

integration (filesystem) o.a.h.fs.ozone.TestOzoneFileSystem.testTrash

HDDS-7283. Set coreSize equal to maxSize for threadPoolExecutor (#3792)

integration (om)

HDDS-7283. Set coreSize equal to maxSize for threadPoolExecutor (#3792)

acceptance (secure)

integration (om)

HDDS-7268. EC: Fix tests for HealthCheck handlers of RM that use Replica Indexes for Ratis Containers (#3793)

HDDS-7268. EC: Fix tests for HealthCheck handlers of RM that use Replica Indexes for Ratis Containers (#3793)

integration (filesystem) o.a.h.fs.ozone.TestOzoneFileSystem (timeout?)

integration (flaky)

HDDS-7268. EC: Fix tests for HealthCheck handlers of RM that use Replica Indexes for Ratis Containers (#3793)

basic (unit) o.a.h.hdds.scm.container.replication.TestReplicationManager (timeout?)

integration (flaky)

HDDS-7229. Introduce container location cache in ScmClient (#3771)

integration (flaky)

HDDS-7206. Change the placement policy interface to allow existing nodes to be specified for Rack Scatter Policy. (#3744...

HDDS-7206. Change the placement policy interface to allow existing nodes to be specified for Rack Scatter Policy. (#3744...

acceptance (unsecure)

integration (flaky)

HDDS-7206. Change the placement policy interface to allow existing nodes to be specified for Rack Scatter Policy. (#3744...

integration (flaky)

HDDS-7206. Change the placement policy interface to allow existing nodes to be specified for Rack Scatter Policy. (#3744...

HDDS-7206. Change the placement policy interface to allow existing nodes to be specified for Rack Scatter Policy. (#3744...

HDDS-7206. Change the placement policy interface to allow existing nodes to be specified for Rack Scatter Policy. (#3744...

integration (flaky)

HDDS-7206. Change the placement policy interface to allow existing nodes to be specified for Rack Scatter Policy. (#3744...

HDDS-7206. Change the placement policy interface to allow existing nodes to be specified for Rack Scatter Policy. (#3744...

integration (flaky)

kubernetes

HDDS-7206. Change the placement policy interface to allow existing nodes to be specified for Rack Scatter Policy. (#3744...

integration (om)

HDDS-7206. Change the placement policy interface to allow existing nodes to be specified for Rack Scatter Policy. (#3744...

HDDS-7263. Add a handler for Quasi Closed containers to RM (#3785)

HDDS-7232. Introduce container-level lock while handling container report events by SCM and Recon (#3766)

integration (filesystem) o.a.h.fs.ozone.TestOzoneFileSystem (timeout?)

integration (flaky)

HDDS-7222. Recon Inactive pipelines not shown. (#3753)

basic (unit) o.a.h.hdds.scm.container.replication.TestReplicationManager (timeout?)

HDDS-6863. Add Group-Id & Ratis-Roles Information for OM UI (#3520)

HDDS-6863. Add Group-Id & Ratis-Roles Information for OM UI (#3520)

integration (filesystem) o.a.h.fs.ozone.TestOzoneFileSystem (timeout?)

integration (filesystem) o.a.h.fs.ozone.TestOzoneFileSystemWithFSO (timeout?)

integration (flaky)

HDDS-7257. Bump snakeyaml to 1.32 (#3776)

HDDS-7257. Bump snakeyaml to 1.32 (#3776)

integration (flaky)

HDDS-7160. Recon: Make Container and Bucket stats clickable in Overviews page (#3775)

HDDS-6492. Add metric for failed container moves (#3751)

acceptance (compat)

HDDS-6492. Add metric for failed container moves (#3751)

HDDS-7145. Recon: Show last OM DB sync time on Overview page (#3765)

integration (flaky)

HDDS-7145. Recon: Show last OM DB sync time on Overview page (#3765)

HDDS-7039. EC: Handle the placement policy check in ECUnderReplicationHandler (#3645)

integration (om)

HDDS-7075. Implement FileSystem listStatusIterator to support file list paging (#3711)

HDDS-7075. Implement FileSystem listStatusIterator to support file list paging (#3711)

integration (filesystem) o.a.h.fs.ozone.TestRootedOzoneFileSystem (timeout?)

HDDS-7075. Implement FileSystem listStatusIterator to support file list paging (#3711)

integration (flaky)

HDDS-7075. Implement FileSystem listStatusIterator to support file list paging (#3711)

integration (flaky)

HDDS-7251. Replace Log4j 1.x with Reload4j (#3773)

acceptance (HA)

HDDS-7251. Replace Log4j 1.x with Reload4j (#3773)

integration (flaky)

HDDS-7251. Replace Log4j 1.x with Reload4j (#3773)

HDDS-7251. Replace Log4j 1.x with Reload4j (#3773)

integration (flaky)

HDDS-7240. List all volume operation should go through ACL check as well in order to trigger audit logging (#3770)

HDDS-7240. List all volume operation should go through ACL check as well in order to trigger audit logging (#3770)

integration (filesystem) o.a.h.fs.ozone.TestRootedOzoneFileSystem (timeout?)

integration (om)

HDDS-7240. List all volume operation should go through ACL check as well in order to trigger audit logging (#3770)

integration (flaky)

integration (ozone) o.a.h.ozone.container.common.statemachine.commandhandler.TestBlockDeletion (timeout?)

HDDS-7239. EC: Add a Handler for CLOSING containers in Replication Manager (#3769)

integration (flaky)

integration (om)

HDDS-7239. EC: Add a Handler for CLOSING containers in Replication Manager (#3769)

HDDS-7239. EC: Add a Handler for CLOSING containers in Replication Manager (#3769)

acceptance (misc)

HDDS-7203. LookupKey Latency breakdown (#3742)

integration (flaky)

integration (om)

HDDS-7185. Encode asterisk for parsing signature (#3726) Co-authored-by: Symious <yiyang0203@gmail.com>

integration (filesystem) o.a.h.fs.ozone.TestOzoneFileSystem (timeout?)

integration (filesystem) o.a.h.fs.ozone.TestDirectoryDeletingServiceWithFSO (timeout?)

HDDS-7185. Encode asterisk for parsing signature (#3726) Co-authored-by: Symious <yiyang0203@gmail.com>

HDDS-7185. Encode asterisk for parsing signature (#3726) Co-authored-by: Symious <yiyang0203@gmail.com>

HDDS-7221. EC: ReplicationManager - Encapsulate the under and over rep queues into a queue object (#3758)

HDDS-7221. EC: ReplicationManager - Encapsulate the under and over rep queues into a queue object (#3758)

kubernetes

HDDS-7207. Fixed typo "layload" in om-echo command description as payload (#3756)

HDDS-7207. Fixed typo "layload" in om-echo command description as payload (#3756)

basic (unit) o.a.h.ozone.security.acl.TestParentAcl (timeout?)

integration (client) o.a.h.ozone.client.rpc.TestBlockOutputStream (timeout?)

integration (flaky)

HDDS-7207. Fixed typo "layload" in om-echo command description as payload (#3756)

HDDS-7207. Fixed typo "layload" in om-echo command description as payload (#3756)

integration (flaky)

HDDS-7207. Fixed typo "layload" in om-echo command description as payload (#3756)

basic (unit) o.a.h.hdds.scm.container.replication.TestReplicationManager (timeout?)

HDDS-7225. Add Ratis tests for HealthCheck handlers of Replication Manager (#3757)

HDDS-7225. Add Ratis tests for HealthCheck handlers of Replication Manager (#3757)

HDDS-7225. Add Ratis tests for HealthCheck handlers of Replication Manager (#3757)

HDDS-7225. Add Ratis tests for HealthCheck handlers of Replication Manager (#3757)

HDDS-7144. Recon: Make only hostname fixed in Datanodes page. (#3736)

HDDS-7144. Recon: Make only hostname fixed in Datanodes page. (#3736)

HDDS-7144. Recon: Make only hostname fixed in Datanodes page. (#3736)

HDDS-7193. S3gateway Grpc Ranger Authorizer NPE Unhandled Exception (#3749) Co-authored-by: neils-dev <neil2021.gres@gm...

HDDS-7114. CHAINED and STAND_ALONE replication-type should be removed from help message (#3672)

HDDS-7114. CHAINED and STAND_ALONE replication-type should be removed from help message (#3672)

HDDS-7114. CHAINED and STAND_ALONE replication-type should be removed from help message (#3672)

acceptance (misc)

HDDS-7192. EC: ReplicationManager - create handlers to perform various container checks (#3743)

HDDS-7209. Bump Jersey2 to 2.34 (#3745)

HDDS-7209. Bump Jersey2 to 2.34 (#3745)

integration (flaky)

HDDS-7204. EC: Schedule UnderReplicatedProcessor and OverReplicatedProcessor threads in RM instead of StorageContainerMa...

integration (hdds)

HDDS-7204. EC: Schedule UnderReplicatedProcessor and OverReplicatedProcessor threads in RM instead of StorageContainerMa...

HDDS-7204. EC: Schedule UnderReplicatedProcessor and OverReplicatedProcessor threads in RM instead of StorageContainerMa...

acceptance (secure)

HDDS-7204. EC: Schedule UnderReplicatedProcessor and OverReplicatedProcessor threads in RM instead of StorageContainerMa...

basic (unit) o.a.h.hdds.scm.container.replication.TestReplicationManager (timeout?)

HDDS-7204. EC: Schedule UnderReplicatedProcessor and OverReplicatedProcessor threads in RM instead of StorageContainerMa...

integration (om)

HDDS-7204. EC: Schedule UnderReplicatedProcessor and OverReplicatedProcessor threads in RM instead of StorageContainerMa...

integration (filesystem) o.a.h.fs.ozone.TestOzoneFileSystemWithFSO (timeout?)

HDDS-7204. EC: Schedule UnderReplicatedProcessor and OverReplicatedProcessor threads in RM instead of StorageContainerMa...

HDDS-7204. EC: Schedule UnderReplicatedProcessor and OverReplicatedProcessor threads in RM instead of StorageContainerMa...

HDDS-7204. EC: Schedule UnderReplicatedProcessor and OverReplicatedProcessor threads in RM instead of StorageContainerMa...

HDDS-7204. EC: Schedule UnderReplicatedProcessor and OverReplicatedProcessor threads in RM instead of StorageContainerMa...

HDDS-7204. EC: Schedule UnderReplicatedProcessor and OverReplicatedProcessor threads in RM instead of StorageContainerMa...

integration (flaky)

HDDS-7174. Migrate SCM integration tests to JUnit 5 (#3722)

HDDS-2476. Share more code between metadata and data scanners. (#3727)

acceptance (secure)

integration (flaky)

HDDS-2476. Share more code between metadata and data scanners. (#3727)

integration (filesystem) o.a.h.fs.ozone.TestOzoneFileSystem (timeout?)

HDDS-7086. DataNode UI to show failed volumes too (#3740)

integration (flaky)