v5.15.0

Release v5.15.0

What's Changed

• Fix docker and podman multi platform build by @tangledbytes in #7402
• add support for RPM package builds by @tangledbytes in #7291
• Support Azure log credentials in update_external_connection by @Neon-White in #7394
• Bug Fix #7400 | Change Connection and Add httpOptions with agent by @shirady in #7401
• Create bucket_diff util by @liranmauda in #7378
• Clean up duplicated functions by @liranmauda in #7406
• Allow the bucket diff constructor to get s3_params OR connection by @liranmauda in #7407
• Migrating to AWS SDK V3 | Add Internal Class to Decide Which AWS SDK Version to Use by @shirady in #7395
• Avoid logging an error message for an expected error by @dannyzaken in #7376
• Abide by RFC 7230 for S3 HTTP headers by @tangledbytes in #7408
• bugfix - LRUCache.invalidate should use item.d, not item.val. by @alphaprinz in #7414
• Replace minikube with standalone deployment for Ceph Tests by @tangledbytes in #7417
• Allow customizing keep-alive and request timeouts for endpoint servers by @tangledbytes in #7419
• Fix Azure log iteration and credentials lookup by @Neon-White in #7420
• BucketDiff is now checking for metadata change if the latest ETag is the same by @liranmauda in #7422
• S3select parquet fs by @alphaprinz in #7293
• passing log candidates as batch for and copy and delete by @achouhan09 in #7375
• Fix space check on TMFS by @tangledbytes in #7424
• NSFS | Versioning | List Object Version - Support for Null Version by @shirady in #7371
• Add #!/bin/bash header to bash files by @romayalon in #7436
• Move sanity tests to standalone deployment by @tangledbytes in #7435
• BucketDiff | Fixing a bug in compare of user metadata by @liranmauda in #7437
• Fix copy_objects() and delete_objects() calls by @Neon-White in #7438
• add semaphore state to noobaa endpoint metrics by @naveenpaul1 in #7384
• Improve Azure log replication iteration by @Neon-White in #7440
• Add Region to Connection Schemas + Use Region in Check Connection by @shirady in #7433
• CI | NSFS Versioning | Increase Timeout for 7 Tests That Failed in the CI by @shirady in #7446
• Remove python dependency explicitly from RPM package by @tangledbytes in #7447
• Object Version Replication - add the ability to replicate object versions. by @liranmauda in #7412
• COPY OBJECT | OBJECT IO | Semaphore deadlock fix by @romayalon in #7443
• Migrating to AWS SDK V3 | Add AWS SDK V3 Wrapper by @shirady in #7442
• Extract log-based replication test into a different file and convert it to jest by @liranmauda in #7427
• Migrating to AWS SDK V3 | Replace node-http-handler Package by @shirady in #7445
• change bucket policy schema to fit AWS json by @nadavMiz in #7389
• Migrating to AWS SDK V3 | Add a Package For Upload by @shirady in #7455
• add bucket authentication for server side encryption algorithm by @nadavMiz in #7273
• Adding support for SSL and connection string for Postgres client + SSL tests (2nd commit) by @jackyalbo in #7464
• Bump dependency by @liranmauda in #7468
• Add test for tiering_ttl_worker by @tangledbytes in #7361
• NC | NSFS | NSFS NC Systemd example script and docs for RPM installation by @romayalon in #7469
• Bump version to 5.15 by @liranmauda in #7471
• NSFS | Merge NSFS standalone changes to master by @naveenpaul1 in #7473
• Migrating to AWS SDK V3 | Implementation In Analyze Resource and Namespace Monitor by @shirady in #7452
• Migrating to AWS SDK V3 | Use AWS SDK V3 In Unit Tests (upgrade_script, dedup, lifecycle) by @shirady in #7457
• Migrating to AWS SDK V3 | Use AWS SDK V3 In Unit Tests (namespace_auth, bucketspace, bucketspace versioning) by @shirady in #7461
• Build RPM - some fixes by @liranmauda in #7474
• Add NotPrefix, NotAction and NotResource to bucket policy by @nadavMiz in #7465
• Remove skipping on log-based replication when sync_deletions is false by @liranmauda in #7476
• NSFS | NC | S3 flow support by @romayalon in #7475
• Migrating to AWS SDK V3 | Use AWS SDK V3 In Unit Tests (s3_bucket_policy, s3_encryption, encryption) by @shirady in #7466
• Migrating to AWS SDK V3 | Add Package client-sts by @shirady in #7480
• Added jest/unit_tests to verify the log parsing and processing flow by @achouhan09 in #7416
• Object Versions Replication - NamespaseS3 fix by @liranmauda in #7488
• NC | NSFS unit test by @naveenpaul1 in #7483
• NamespaceS3 | fix read_object_md for versionID by @liranmauda in #7487
• removed aws_usage_metering bg_worker by @dannyzaken in #7492
• Log based replication | Fix the copy object flow on non-versioned objects by @liranmauda in #7497
• Update account API for updation of force_md5_etag by @achouhan09 in #7491
• Migrating to AWS SDK V3 | Use AWS SDK V3 In Unit Tests (s3_ops) by @shirady in #7479
• Pass Region For Namespace S3 by @shirady in #7489
• [NSFS] Initialize restore_object API by @tangledbytes in #7501
• NSFS | NC | Replace fs_root with absolute paths, rename bucketspace_multi_fs to bucketspace_FS by @romayalon in #7500
• Some core fixes for external DB by @jackyalbo in #7504
• Namespace GCP | Adding read_object_stream by @liranmauda in #7503
• NSFS | NC | nsfs health check by @naveenpaul1 in #7499
• Migrating to AWS SDK V3 | Implementation In Account Server and Bucket Server by @shirady in #7478
• increase timeout for bucket policy unit tests by @nadavMiz in #7511
• Migrating to AWS SDK V3 | Implementation In BucketSpaceS3 (And nscache) by @shirady in #7481
• NSFS | NC | set /etc/noobaa.conf.d as default config_root and a small bug fix by @romayalon in #7509
• Log based replication | Add copy object flow for versioned objects by @liranmauda in #7508
• [NC | NSFS] RPM Upgrades by @tangledbytes in #7493
• NSFS | NC | bucket and account manage CLI by @naveenpaul1 in #7510
• NSFS | NC | Small fixes and Docs updates by @romayalon in #7505
• NSFS | NC | CLI | fix nsfs cli uid/gid=0 issue by @romayalon in #7515
• [NSFS] Add support for restore-object by @tangledbytes in #7507
• NSFS | Fix nsfs simple fs tool by @romayalon in #7517
• NSFS | MPU | optimization by @romayalon in #7434
• NC | NSFS |Add command replace the existing file - fix by @naveenpaul1 in #7516
• [NSFS | NC] Add items that are required for successful deployment on tape platform by @tangledbytes in #7526
• bucket logging endpoint changes by @aspandey in #7426
• Add Prometheus for log-based replication + fix in non version log-based replication copy flow by @liranmauda in #7525
• Bumping dependencies by @liranmauda in #7529
• Improve archive deployment docs by @tangledbytes in #7528
• [NC | NSFS] Add mm policy migration rule to kick in every 15 mins by @tangledbytes in #7530
• NSFS | NC | Add syslog configuration on RPM by @naveenpaul1 in #7531
• Reload certs 2237903 watch by @alphaprinz in #7502
• NSFS | NC | nsfs service additions by @romayalon in #7518
• Added a check for bidirectional replication for matching prefix by @achouhan09 in #7524
• NC | NSFS | HTTP and certificate configurations by @naveenpaul1 in #7533
• Add Logs In http_utils.js by @shirady in #7535
• NSFS | NC | fix bucket policy issue by @romayalon in #7536
• Bump @babel/traverse from 7.23.0 to 7.23.2 by @dependabot in #7539
• NSFS | Content-type / directory object fixes by @romayalon in #7498
• NSFS | NC | removing system store requirement from nsfs.js by @romayalon in #7545
• NC | NSFS | HTTP Server not Starting, but logging mismatch by @naveenpaul1 in #7553
• NC | NSFS | Schema validation by @naveenpaul1 in #7544
• Bumed node version from 18.14.2 to 18.18.2 by @liranmauda in #7558
• NSFS | NC | Atomic creation of buckets and accounts config files (bucketspace FS and CLI) by @romayalon in #7522
• RPM build updates for downstream builds by @b-ranto in #7550
• NSFS | NC | github action for manual & nightly rpm build and upload it as artifact / s3 by @romayalon in #7561
• Adding distinguished_name to nsfs_account_config by @jackyalbo in #7560
• NSFS | NC | Fix nightly rpm build final path by @romayalon in #7566
• Standalone |CLI | Fix help by @liranmauda in #7563
• run ceph s3 tests on nsfs by @v-harihar in #7456
• NSFS | NC | fix ENDPOINT_FORKS usage by @romayalon in #7570
• Fix Backingstore AWS STS - Pass the Role ARN by @shirady in #7569
• Fix - bidirectional validation flow should work with operator flow by @achouhan09 in #7555
• Replace revisions with current date by @tangledbytes in #7575
• Support role config deletion by @Neon-White in #7573
• CI | Update Ceph S3 Tests (Commit Hash Number and Pending Lists) by @shirady in #7589
• Standalone | CLI | fix account list issues by @liranmauda in #7568
• docker build - bump base image to centos stream 9 by @alphaprinz in #7571
• NC | NSFS | Events by @naveenpaul1 in #7540
• NSFS | NC | Object Tagging by @naveenpaul1 in #7572
• NSFS | NC | Event syslog undefined -fix by @naveenpaul1 in #7600
• Exclude storage_class from new_tier_defaults when it's not provided by @Neon-White in #7596
• [NC | NSFS] Fix NSFS prometheus write bytes by @tangledbytes in #7602
• NSFS | NC | Actions | fix RHEL 9 rpm suffix by @romayalon in #7607
• NSFS | NC | Configuration | accounts/ and access_keys/ directories changes by @romayalon in #7591
• NSFS | NC | Docs improvements by @romayalon in #7597
• NSFS | NC | CLI | create config dirs if they don't exists by @romayalon in #7610
• Revert secrets prints fix by @romayalon in #7613
• parameterize centos base image version by @alphaprinz in #7611
• NSFS | NC | github actions rpm build fix for both centos8 and centos9 by @romayalon in #7614
• NSFS | NC | remove stat from verify_gpfs_lib() by @romayalon in #7617
• NC | NSFS | Health script missing features by @naveenpaul1 in #7603
• NSFS | NC | move /etc/noobaa.conf.d/.env location to /etc/sysconfig/noobaa and redirect file read addition by @romayalon in #7606
• NSFS | NC | config.json load implementation instead of env file usage by @romayalon in #7618
• upgrade packages. Bypass google stroage UserAgent rewrite. by @alphaprinz in #7627
• NSFS | NC | Update system.json structure + small redirect fix by @romayalon in #7638
• Fixes Related To AWS STS (in BlockStoreS3 And add_external_connection) by @shirady in #7577
• Update projectedServiceAccountToken path by @shirady in #7623
• NSFS | NC | CLI | read and write permissions of config subdirs and file fix and other small fixes by @romayalon in #7624
• NSFS | NC | CLI | Update config root default of manage_nsfs and health by @romayalon in #7641
• NSFS | NC | fix type of ports in nsfs config schema by @romayalon in #7643
• NSFS | NC | CLI | Remove unwanted console logs for manage NSFS script by @naveenpaul1 in #7640
• NSFS | NC |endpoint metrics should aggregated fork by @naveenpaul1 in #7562
• test_encryption namesapce resource target bucket fix, update_external_connection fix for node20 by @alphaprinz in #7654
• Adapt http-proxy-agent updated api by @alphaprinz in #7657
• node20 - workaround for ping by @alphaprinz in #7658
• NSFS | NC | add root permission requirement for health and manage scripts by @romayalon in #7661
• NSFS | NC | Add white list IP table support for S3 by @naveenpaul1 in #7653
• NSFS | NC | replace bucketspace_fs user fs_context with root fs_context on config files ops by @romayalon in #7662
• NSFS | NC | CLI | CLI commands responses & errors refactor, --show_secrets and lstat linux fix by @romayalon in #7655
• [Backport to 5.15] upgrade to node 20.9.0. ignore deprecated warnings to make nan compile by @dannyzaken in #7669
• [Backport into 5.15] config disable ns monitor, md aggregator, issues report, pg inspect prining + manage_nsfs | Generate access keys by @liranmauda in #7670
• [Backport to 5.15] Backport non-contanarized NS FS fixes to 5.15 by @nimrod-becker in #7696
• [BAckport into 5.15] NSFS | CLI | few fixes by @liranmauda in #7704
• [Backport to 5.15] Add experimental support for STS CLI usage (#7605) by @dannyzaken in #7709
• Backport to 5.15 by @nimrod-becker in #7712
• BACKPORT 5.15 by @romayalon in #7749
• [Backport to 5.15] NS FS Non Contanarized fixes by @nimrod-becker in #7771
• [Backport tp 5.15] fix NooBaa NSFS RPM Upgrade by @nimrod-becker in #7778
• Backport to 5.15 by @romayalon in #7824
• [Backport 5.15] PR 7601,7822,7825 by @tangledbytes in #7821
• [Backport to 5.15] fixed signature calculations for cpp aws-sdk by @dannyzaken in #7840
• [Backport into 5.15] namespace_monitor.js | Fixing the error object values to start with a lowercase by @liranmauda in #7849
• [Backport into 5.15] Fix CVE-2023-42282 by @liranmauda in #7852

Full Changelog: v5.14.5...v5.15.0