Skip to content

Latest commit

 

History

History
1614 lines (1332 loc) · 79.8 KB

CHANGELOG.md

File metadata and controls

1614 lines (1332 loc) · 79.8 KB
Raw

Database Tools Changelog

100.10.0

Released 2024-07-24

We are pleased to announce version 100.10.0 of the MongoDB Database Tools.

This version adds support for MongoDB Server 8.0, and support for Ubuntu 24.04 platforms. It also updates several packages and fixes a bug.

The Database Tools are available on the MongoDB Download Center. Installation instructions and documentation can be found on docs.mongodb.com/database-tools. Questions and inquiries can be asked on the MongoDB Developer Community Forum. Please make sure to tag forum posts with database-tools. Bugs and feature requests can be reported in the Database Tools Jira where a list of current issues can be found.

Vulnerability

Release

Bug

  • [TOOLS-3611] - Mongodump and restore should not produce a JSON format error on $-prefixed object keys

Epic

Task

  • [TOOLS-3546] - Support vectored insertion oplog format
  • [TOOLS-3572] - Fix file names for released deb packages
  • [TOOLS-3574] - Run integration tests against 8.0 and add ubuntu2404 variants
  • [TOOLS-3575] - Support dump and restore mixed-schema timeseries buckets
  • [TOOLS-3604] - Add platforms rhel8.8 (x86_64 and arm64) and rhel9.3 (x86_64 and arm64)
  • [TOOLS-3613] - Run qa and legacy tests against 8.0
  • [TOOLS-3616] - Update go driver version to v1.16.0

100.9.5

Released 2024-06-17

We are pleased to announce version 100.9.5 of the MongoDB Database Tools.

For this release we have updated many of our third-party dependencies, as well adding third-party dependency vulnerability scanning, static analysis, and other tooling to comply with MongoDB's Software Security Development Lifecycle initiative. Notably, all releases now ship with a Software Bill of Materials (SBOM). Look for a file ending with .cdx.json in the archive. For OS packages, this file should be installed in an appropriate location for each package, like /usr/share/docs for deb packages.

The Database Tools are available on the MongoDB Download Center. Installation instructions and documentation can be found on docs.mongodb.com/database-tools. Questions and inquiries can be asked on the MongoDB Developer Community Forum. Please make sure to tag forum posts with database-tools. Bugs and feature requests can be reported in the Database Tools Jira where a list of current issues can be found.

Investigation

  • [TOOLS-3486] - Investigate changes in SERVER-81378: Change classic behavior: equality to null should not match undefined
  • [TOOLS-3498] - Investigate changes in SERVER-86928: Local Privilege Escalation via Untrusted Directory | mongodbldap.exe
  • [TOOLS-3500] - Investigate changes in SERVER-88071: Deprecate filemd5 with the intent of eventual removal

Bug

  • [TOOLS-3519] - mongodump/mongoreplay docs don't include a disclaimer against using --oplog/--oplogReplay in sharded clusters
  • [TOOLS-3554] - Security Vulnerability in mongodb db tools packages

Task

  • [TOOLS-3499] - Clean up release code to remove unused tags and remove libsasl.dll from MSI
  • [TOOLS-3526] - Artifact: Authorized publication on distribution channels for DB Tools 7.0.x*
  • [TOOLS-3527] - Artifact: Third Party Dependencies Report for DB Tools 7.0.x*
  • [TOOLS-3528] - Prep for Silk Onboarding: Add DB Tools to Silk Inventory
  • [TOOLS-3532] - Onboard DB Tools to Papertrail Service for SSDLC Compliance
  • [TOOLS-3534] - Integrate this project with Snyk for third-party vulnerability scanning
  • [TOOLS-3535] - Add gosec as a linter and add minimal precious config
  • [TOOLS-3550] - Create augmented SBOM file and add it to the release artifacts
  • [TOOLS-3551] - Fix integration test failures with MongoDB 8.0 RC release
  • [TOOLS-3555] - Remove support for Debian 8
  • [TOOLS-3559] - Include the Augmented SBOM in all release artifacts
  • [TOOLS-3565] - Artifact: Static Code Analysis Report for DB Tools 7.0.x*

100.9.4

Released 2023-12-7

We are pleased to announce version 100.9.4 of the MongoDB Database Tools.

This version bumps the minimum go version to 1.20.12.

The Database Tools are available on the MongoDB Download Center. Installation instructions and documentation can be found on docs.mongodb.com/database-tools. Questions and inquiries can be asked on the MongoDB Developer Community Forum. Please make sure to tag forum posts with database-tools. Bugs and feature requests can be reported in the Database Tools Jira where a list of current issues can be found.

Release

  • [TOOLS-3438] - Release Database Tools 100.9.4 and update go version to 1.20.12

100.9.3

Released 2023-11-17

We are pleased to announce version 100.9.3 of the MongoDB Database Tools.

This version addresses an issue that led to installation failures of MongoDB Database Tools on Debian 12 and also resolves incompatibility with Debian 11.

The Database Tools are available on the MongoDB Download Center. Installation instructions and documentation can be found on docs.mongodb.com/database-tools. Questions and inquiries can be asked on the MongoDB Developer Community Forum. Please make sure to tag forum posts with database-tools. Bugs and feature requests can be reported in the Database Tools Jira where a list of current issues can be found.

Bug

  • [TOOLS-3429] - MongoDB Database Tools 100.9.2 not compatible with Debian 11 (Bullseye)

100.9.2

Released 2023-11-16

We are pleased to announce version 100.9.2 of the MongoDB Database Tools.

This version adds support for Debian 12.

The Database Tools are available on the MongoDB Download Center. Installation instructions and documentation can be found on docs.mongodb.com/database-tools. Questions and inquiries can be asked on the MongoDB Developer Community Forum. Please make sure to tag forum posts with database-tools. Bugs and feature requests can be reported in the Database Tools Jira where a list of current issues can be found.

Task

100.9.1

Released 2023-11-09

We are pleased to announce version 100.9.1 of the MongoDB Database Tools.

This version updates external dependencies and fixes an issue where mongodump could change the ordering of fields in a view definition.

The Database Tools are available on the MongoDB Download Center. Installation instructions and documentation can be found on docs.mongodb.com/database-tools. Questions and inquiries can be asked on the MongoDB Developer Community Forum. Please make sure to tag forum posts with database-tools. Bugs and feature requests can be reported in the Database Tools Jira where a list of current issues can be found.

Bug

  • [TOOLS-3367] - Building fails: failed to detect local platform from kernel name
  • [TOOLS-3388] - mongodb/mongo-tools master :go.mod - Denial of Service DoS in golang.org/x/net
  • [TOOLS-3411] - MongoDump does not maintain field-order for sort and match in Views

100.9.0

Released 2023-10-20

We are pleased to announce version 100.9.0 of the MongoDB Database Tools.

This version adds support for MongoDB Server 7.0. It also updates the Go version used to build the tools to Go 1.20.10.

The Database Tools are available on the MongoDB Download Center. Installation instructions and documentation can be found on docs.mongodb.com/database-tools. Questions and inquiries can be asked on the MongoDB Developer Community Forum. Please make sure to tag forum posts with database-tools. Bugs and feature requests can be reported in the Database Tools Jira where a list of current issues can be found.

Epic

100.8.0

Released 2023-08-16

We are pleased to announce version 100.8.0 of the MongoDB Database Tools.

This version uploads the MongoDB Database Tools to the MongoDB Linux v7.0 repos.

The Database Tools are available on the MongoDB Download Center. Installation instructions and documentation can be found on docs.mongodb.com/database-tools. Questions and inquiries can be asked on the MongoDB Developer Community Forum. Please make sure to tag forum posts with database-tools. Bugs and feature requests can be reported in the Database Tools Jira where a list of current issues can be found.

Release

Bug

  • [TOOLS-3368] - MongoDB 7 Linux repos are missing mongodb-database-tools

100.7.5

Released 2023-08-07

We are pleased to announce version 100.7.5 of the MongoDB Database Tools.

This version updates Go to 1.19.12. This release of Go includes a security fix to the crypto/tls package.

This version no longer supports the PowerPC Ubuntu 18.04 platform.

The Database Tools are available on the MongoDB Download Center. Installation instructions and documentation can be found on docs.mongodb.com/database-tools. Questions and inquiries can be asked on the MongoDB Developer Community Forum. Please make sure to tag forum posts with database-tools. Bugs and feature requests can be reported in the Database Tools Jira where a list of current issues can be found.

Task

  • [TOOLS-3349] - Add integration testing for mongodump/restore on config db (and other special case dbs)
  • [TOOLS-3365] - Release Database Tools 100.7.5 with golang 1.19.12

100.7.4

Released 2023-07-21

We are pleased to announce version 100.7.4 of the MongoDB Database Tools.

This release fixes issues with mongorestore that ommitted all namespaces containing "admin" when restoring to an Atlas Proxy Cluster. This release also fixes an issue with mongodump where the process failed against clusters using Atlas Online Archive.

The Database Tools are available on the MongoDB Download Center. Installation instructions and documentation can be found on docs.mongodb.com/database-tools. Questions and inquiries can be asked on the MongoDB Developer Community Forum. Please make sure to tag forum posts with database-tools. Bugs and feature requests can be reported in the Database Tools Jira where a list of current issues can be found.

Bug

  • [TOOLS-3338] - Mongorestore to Atlas Proxy fails for any collection containing "admin"
  • [TOOLS-3344] - Mongodump does not work with Atlas Data Federation.

100.7.3

Released 2023-06-26

We are pleased to announce version 100.7.3 of the MongoDB Database Tools.

This release fixes an issue introduced in 100.7.1 where specifying mongodump --db=confg will not dump the entire config collection.

The Database Tools are available on the MongoDB Download Center. Installation instructions and documentation can be found on docs.mongodb.com/database-tools. Questions and inquiries can be asked on the MongoDB Developer Community Forum. Please make sure to tag forum posts with database-tools. Bugs and feature requests can be reported in the Database Tools Jira where a list of current issues can be found.

Bug

  • [TOOLS-3324] - Fix failure to dump needed sharded collections from config database

Task

  • [TOOLS-3319] - Change mongorestore so that it works with atlas proxy backup tests

100.7.2

Released 2023-05-30

We are pleased to announce version 100.7.2 of the MongoDB Database Tools.

This release fixes an issue with installing Database Tools on RHEL aarch64 architecture.

The Database Tools are available on the MongoDB Download Center. Installation instructions and documentation can be found on docs.mongodb.com/database-tools. Questions and inquiries can be asked on the MongoDB Developer Community Forum. Please make sure to tag forum posts with database-tools. Bugs and feature requests can be reported in the Database Tools Jira where a list of current issues can be found.

Bug

  • [TOOLS-3309] - Fix release issue on RHEL ARM architecture

100.7.1

Released 2023-05-24

We are pleased to announce version 100.7.1 of the MongoDB Database Tools.

This release fixes a few bugs and adds downloads for macOS 11 on ARM as well as RedHat Enterprise Linux 9 (x86 and ARM) and Amazon Linux 2023 (x86 and ARM).

Downloads were compiled with Go 1.19.9.

The Database Tools are available on the MongoDB Download Center. Installation instructions and documentation can be found on docs.mongodb.com/database-tools. Questions and inquiries can be asked on the MongoDB Developer Community Forum. Please make sure to tag forum posts with database-tools. Bugs and feature requests can be reported in the Database Tools Jira where a list of current issues can be found.

Bug

  • [TOOLS-2598] - Tools improperly parse multi-certs inside client certificate file
  • [TOOLS-3203] - mongodump fails because it can’t query system.sharding_ddl_coordinators collection
  • [TOOLS-3273] - Validation added in 100.7.0 prevents Atlas proxy from running "mongodump"
  • [TOOLS-3279] - Test suite segfaults in some failure cases

Task

  • [TOOLS-2722] - Add MacOS 11.0 ARM to Tools
  • [TOOLS-3052] - Add Amazon Linux 2023 ARM to Tools
  • [TOOLS-3054] - Add RHEL9 ARM to Tools
  • [TOOLS-3062] - Add Amazon Linux 2023 to Tools
  • [TOOLS-3276] - Skip columnstore indexes tests in mongodump and mongorestore if error is NotImplemented

100.7.0

Released 2023-03-01

We are pleased to announce version 100.7.0 of the MongoDB Database Tools.

This release adds tests against MongoDB 6.3. Highlights include new tests for Column Store Indexes, updating the minimum Go version to 1.19, fixing a bug that caused the Tools to ignore a password supplied via a prompt. Several build failures are also fixed in this version.

The Database Tools are available on the MongoDB Download Center. Installation instructions and documentation can be found on docs.mongodb.com/database-tools. Questions and inquiries can be asked on the MongoDB Developer Community Forum. Please make sure to tag forum posts with database-tools. Bugs and feature requests can be reported in the Database Tools Jira where a list of current issues can be found.

Bug

  • [TOOLS-3243] - Tools produce error about missing password after prompting for a password

Epic

Task

  • [TOOLS-3169] - Upgrade Go to 1.19
  • [TOOLS-3202] - Fix legacy-jstests failure with latest Server (6.1)
  • [TOOLS-3208] - Investigate test failures in HEAD and make more tickets as needed
  • [TOOLS-3229] - Ignore admin database in dump/restore for atlasProxy
  • [TOOLS-3241] - Fix flaky TestFailDuringResharding test
  • [TOOLS-3247] - Remove mongo-tools support for ZAP PPC64LE Ubuntu 16.04
  • [TOOLS-3248] - Fix TestRestoreTimeseriesCollections for server 6.3+
  • [TOOLS-3249] - Remove mongo-tools support for server version 3.4 on MacOS
  • [TOOLS-3250] - Fix aws-auth task failures
  • [TOOLS-3251] - Update common.yml to run tests with 6.3
  • [TOOLS-3252] - Test support for Columnstore Indexes
  • [TOOLS-3255] - Fix qa-tests-3.4
  • [TOOLS-3256] - Make the push tasks only run on git tags
  • [TOOLS-3257] - Override deprecated mongo shell functions to fix qa-tests-latest
  • [TOOLS-3259] - Remove 6.3 tests on `ZAP s390x RHEL 7.2` and `ZAP PPC64LE RHEL 8.1`
  • [TOOLS-3260] - Fix qa-tests on Debian 11

100.6.1

Released 2022-11-03

We are pleased to announce version 100.6.1 of the MongoDB Database Tools.

This release fixes an issue where users without permissions to read config.system.preimages could not run mongodump. This release also fixes issues with installing the Database Tools on Amazon Linux 2 aarch64 and RHEL 8.3 s390x. The Database Tools are now available on RHEL 9.0 x86. We also made several improvements to our testing and release infrastructure.

The Database Tools are available on the MongoDB Download Center. Installation instructions and documentation can be found on docs.mongodb.com/database-tools. Questions and inquiries can be asked on the MongoDB Developer Community Forum. Please make sure to tag forum posts with database-tools. Bugs and feature requests can be reported in the Database Tools Jira where a list of current issues can be found.

Bug

Task

100.6.0

Released 2022-08-19

We are pleased to announce version 100.6.0 of the MongoDB Database Tools.

This release introduces a security enhancement. The tools will interactively prompt for a SSL key password if the corresponding SSL key is encrypted and no password is provided on the command line.

The Database Tools are available on the MongoDB Download Center. Installation instructions and documentation can be found on docs.mongodb.com/database-tools. Questions and inquiries can be asked on the MongoDB Developer Community Forum. Please make sure to tag forum posts with database-tools. Bugs and feature requests can be reported in the Database Tools Jira where a list of current issues can be found.

New Feature

100.5.4

Released 2022-07-19

We are pleased to announce version 100.5.4 of the MongoDB Database Tools.

This release mostly consists of build failure fixes, support for new platforms, and tests against server version 6.0. The new platforms are Debian 11 on x86, Ubuntu 22.04 on x86 and ARM, and RHEL 8.3 on s390x. The version of Go driver used by the tools has been updated to 1.10.0.

The Database Tools are available on the MongoDB Download Center. Installation instructions and documentation can be found on docs.mongodb.com/database-tools. Questions and inquiries can be asked on the MongoDB Developer Community Forum. Please make sure to tag forum posts with database-tools. Bugs and feature requests can be reported in the Database Tools Jira where a list of current issues can be found.

Build Failure

Task

100.5.3

Released 2022-06-14

We are pleased to announce version 100.5.3 of the MongoDB Database Tools.

This release contains a number of bug fixes and changes. Highlights include support for clustered collections in mongorestore, updating our Go version from 1.16.7 to 1.17.8 to address CVEs, and supported platform updates.

The Database Tools are available on the MongoDB Download Center. Installation instructions and documentation can be found on docs.mongodb.com/database-tools. Questions and inquiries can be asked on the MongoDB Developer Community Forum. Please make sure to tag forum posts with database-tools. Bugs and feature requests can be reported in the Database Tools Jira where a list of current issues can be found.

Build Failure

Bug

Task

100.5.2

Released 2022-02-01

We are pleased to announce version 100.5.2 of the MongoDB Database Tools.

This release fixes an issue where inserting large documents with mongorestore or mongoimport could cause extremely high memory usage (TOOLS-2875). It also fixes a few minor bugs.

The Database Tools are available on the MongoDB Download Center. Installation instructions and documentation can be found on docs.mongodb.com/database-tools. Questions and inquiries can be asked on the MongoDB Developer Community Forum. Please make sure to tag forum posts with database-tools. Bugs and feature requests can be reported in the Database Tools Jira where a list of current issues can be found.

Bug

  • [TOOLS-2745] - Tools don't support setting retryWrites=false in URI parameter
  • [TOOLS-2983] - Some error messages for conflicting URI/CLI arguments are misleading

Task

  • [TOOLS-2875] - Limit the BufferedBulkInserter's batch size by bytes

100.5.1

Released 2021-10-12

We are pleased to announce version 100.5.1 of the MongoDB Database Tools.

This release fixes an issue where certain config collections which should generally be ignored were included by mongodump/mongorestore. This release also ensures that any operations on these collections will not be applied during the oplog replay phase of mongorestore.

The Database Tools are available on the MongoDB Download Center. Installation instructions and documentation can be found on docs.mongodb.com/database-tools. Questions and inquiries can be asked on the MongoDB Developer Community Forum. Please make sure to tag forum posts with database-tools. Bugs and feature requests can be reported in the Database Tools Jira where a list of current issues can be found.

Bug

  • [TOOLS-2952] - Filter config collections in dump/restore

100.5.0

Released 2021-08-10

We are pleased to announce version 100.5.0 of the MongoDB Database Tools.

This release includes support for the loadbalanced URI option, which provides compatibility with MongoDB Atlas Serverless.

The Database Tools are available on the MongoDB Download Center. Installation instructions and documentation can be found on docs.mongodb.com/database-tools. Questions and inquiries can be asked on the MongoDB Developer Community Forum. Please make sure to tag forum posts with database-tools. Bugs and feature requests can be reported in the Database Tools Jira where a list of current issues can be found.

Build Failure

  • [TOOLS-2938] - Re-add Ubuntu 16.04 PowerPC platform

Release

Bug

  • [TOOLS-2863] - cs.AuthMechanismProperties is not initialized when mechanism set by --authenticationMechanism

New Feature

  • [TOOLS-2937] - Set loadbalanced option in db.configureClient()

Task

100.4.1

Released 2021-07-23

We are pleased to announce version 100.4.1 of the MongoDB Database Tools.

This patch fixes a bug (TOOLS-2931) that was introduced in version 100.4.0 which causes mongodump to skip any document that contains an empty field name (e.g. { "": "foo" }). Documents with empty field names were not skipped by default if the --query or --queryFile options were specified. No tools other than mongodump were affected. It is highly recommended to upgrade to 100.4.1 if it is possible that your database contains documents with empty field names.

The Database Tools are available on the MongoDB Download Center. Installation instructions and documentation can be found on docs.mongodb.com/database-tools. Questions and inquiries can be asked on the MongoDB Developer Community Forum. Please make sure to tag forum posts with database-tools. Bugs and feature requests can be reported in the Database Tools Jira where a list of current issues can be found.

Build Failure

  • [TOOLS-2927] - Clean up the platforms list inside platform.go

Release

Bug

  • [TOOLS-2931] - mongodump skips documents with empty field names

Task

  • [TOOLS-2926] - Run release on 'test' and 'development' linux repo separately.

100.4.0

Released 2021-07-19

We are pleased to announce version 100.4.0 of the MongoDB Database Tools.

This release includes server 5.0 support, including dump/restoring timeseries collections.

The Database Tools are available on the MongoDB Download Center. Installation instructions and documentation can be found on docs.mongodb.com/database-tools. Questions and inquiries can be asked on the MongoDB Developer Community Forum. Please make sure to tag forum posts with database-tools. Bugs and feature requests can be reported in the Database Tools Jira where a list of current issues can be found.

Build Failure

  • [TOOLS-2892] - aws-auth tests failing on all variants
  • [TOOLS-2893] - legacy-js-tests 4.4 and 5.0 failing on all variants

Release

Bug

  • [TOOLS-2041] - Mongorestore should handle duplicate key errors during oplog replay
  • [TOOLS-2833] - Creating an index with partialFilterExpression during oplogReplay fails
  • [TOOLS-2925] - RPM packages are only signed with the 4.4 auth token

New Feature

  • [TOOLS-2857] - Dump timeseries collections
  • [TOOLS-2858] - Mongodump can query timeseries collections by metadata
  • [TOOLS-2859] - Restore timeseries collections
  • [TOOLS-2860] - Include/Exclude/Rename timeseries collections in mongorestore

Task

  • [TOOLS-2719] - Add Enterprise RHEL 8 zSeries to Tools
  • [TOOLS-2721] - Add RHEL8 ARM to Tools
  • [TOOLS-2777] - Generate Full JSON variant should not be running on every commit
  • [TOOLS-2823] - Build with go 1.16
  • [TOOLS-2824] - Add static analysis task that runs "evergreen validate"
  • [TOOLS-2849] - Mongodump should fail during resharding
  • [TOOLS-2850] - Mongorestore should fail when restoring geoHaystack indexes to 4.9.0
  • [TOOLS-2851] - importCollection command should cause mongodump to fail
  • [TOOLS-2853] - Hide deprecated --slaveOk option
  • [TOOLS-2866] - Drop support for zSeries platforms
  • [TOOLS-2873] - Run full test suite on all supported distros in evergreen
  • [TOOLS-2881] - Push tools releases to 4.9+ linux repos
  • [TOOLS-2921] - Upgrade to Go Driver 1.6

100.3.1

Released 2021-03-17

We are pleased to announce version 100.3.1 of the MongoDB Database Tools.

This release includes various bug fixes. Particularly notable is TOOLS-2783, where we reverted a change from 100.2.1 (TOOLS-1856: use a memory pool in mongorestore) after discovering that it was causing memory usage issues.

The Database Tools are available on the MongoDB Download Center. Installation instructions and documentation can be found on docs.mongodb.com/database-tools. Questions and inquiries can be asked on the MongoDB Developer Community Forum. Please make sure to tag forum posts with database-tools. Bugs and feature requests can be reported in the Database Tools Jira where a list of current issues can be found.

Build Failure

  • [TOOLS-2796] - mongotop_sharded.js failing on all versions of the qa-tests
  • [TOOLS-2815] - Development build artifacts accidentally uploaded for versioned release

Release

Bug

  • [TOOLS-2584] - Restoring single BSON file should use db set in URI
  • [TOOLS-2783] - Mongorestore uses huge amount of RAM

Task

  • [TOOLS-704] - Remove system.indexes collection dumping from mongodump
  • [TOOLS-2801] - Migrate from dep to Go modules and update README
  • [TOOLS-2802] - Make mongo-tools-common a subpackage of mongo-tools
  • [TOOLS-2805] - Add mod tidy static analysis check for Go modules
  • [TOOLS-2806] - Migrate mongo-tools-common unit tests to mongo-tools
  • [TOOLS-2807] - Migrate mongo-tools-common integration tests to mongo-tools
  • [TOOLS-2808] - Migrate mongo-tools-common IAM auth tests to mongo-tools

100.3.0

Released 2021-02-04

We are pleased to announce version 100.3.0 of the MongoDB Database Tools.

This release includes support for PKCS8-encrypted client private keys, support for providing secrets in a config file instead of on the command line, and a few small bug fixes.

The Database Tools are available on the MongoDB Download Center. Installation instructions and documentation can be found on docs.mongodb.com/database-tools. Questions and inquiries can be asked on the MongoDB Developer Community Forum. Please make sure to tag forum posts with database-tools. Bugs and feature requests can be reported in the Database Tools Jira where a list of current issues can be found.

Build Failure

  • [TOOLS-2795] - Tools failing to build on SUSE15-sp2
  • [TOOLS-2800] - RPM creation failing on amazon linux 1

Release

Investigation

  • [TOOLS-2771] - SSL connection problems mongodump

Bug

  • [TOOLS-2751] - Deferred query EstimatedDocumentCount helper incorrect with filter
  • [TOOLS-2760] - rpm package should not obsolete itself
  • [TOOLS-2775] - --local does not work with multi-file get or get_regex

New Feature

  • [TOOLS-2779] - Add --config option for password values

Task

  • [TOOLS-2013] - Support PKCS8 encrypted client private keys
  • [TOOLS-2707] - Build mongo-tools and mongo-tools-common with go 1.15
  • [TOOLS-2780] - Add warning when password value appears on command line
  • [TOOLS-2798] - Add Amazon Linux 2 Arm64 to Tools

100.2.1

Released 2020-11-13

We are pleased to announce version 100.2.1 of the MongoDB Database Tools.

This release includes a mongorestore performance improvement, a fix for a bug affecting highly parallel mongorestores, and an observability improvement to mongodump and mongoexport, in addition to a number of internal build/release changes.

The Database Tools are available on the MongoDB Download Center. Installation instructions and documentation can be found on docs.mongodb.com/database-tools. Questions and inquiries can be asked on the MongoDB Developer Community Forum. Please make sure to tag forum posts with database-tools. Bugs and feature requests can be reported in the Database Tools Jira where a list of current issues can be found.

Build Failure

Release

Bug

  • [TOOLS-2744] - mongorestore not scaling due to unnecessary incremental sleep time

New Feature

  • [TOOLS-2750] - Log before getting collection counts

Task

  • [TOOLS-1856] - use a memory pool in mongorestore
  • [TOOLS-2651] - Simplify build scripts
  • [TOOLS-2687] - Add archived releases JSON feed for Database Tools
  • [TOOLS-2735] - Move server vendoring instructions to a README in the repo
  • [TOOLS-2748] - Add a String() to OpTime
  • [TOOLS-2758] - Bump Go driver to 1.4.2

100.2.0

Released 2020-10-15

We are pleased to announce version 100.2.0 of the MongoDB Database Tools.

This release deprecates the --sslAllowInvalidHostnames and --sslAllowInvalidCertificates flags in favor of a new --tlsInsecure flag. The mongofiles put and mongofiles get commands can now accept a list of file names. There is a new mongofiles get_regex command to retrieve all files matching a regex pattern. The 100.2.0 release also contains fixes for several bugs. It fixes a bug introduced in version 100.1.0 that made it impossible to connect to clusters with an SRV connection string (TOOLS-2711).

The Database Tools are available on the MongoDB Download Center. Installation instructions and documentation can be found on docs.mongodb.com/database-tools. Questions and inquiries can be asked on the MongoDB Developer Community Forum. Please make sure to tag forum posts with database-tools. Bugs and feature requests can be reported in the Database Tools Jira where a list of current issues can be found.

Build Failure

  • [TOOLS-2693] - Most tasks failing on race detector variant
  • [TOOLS-2737] - Fix TLS tests on Mac and Windows
  • [TOOLS-2747] - Git tag release process does not work

Release

Bug

  • [TOOLS-2587] - sslAllowInvalidHostnames bypass ssl/tls server certification validation entirely
  • [TOOLS-2688] - mongodump does not handle EOF when passing in the password as STDIN
  • [TOOLS-2706] - tar: implausibly old time stamp error on Amazon Linux/RHEL
  • [TOOLS-2708] - Atlas recommended connection string for mongostat doesn't work
  • [TOOLS-2710] - Non-zero index key values are not preserved in ConvertLegacyIndexes
  • [TOOLS-2711] - Tools fail with "a direct connection cannot be made if multiple hosts are specified" if mongodb+srv URI or a legacy uri containing multiple mongos is specified
  • [TOOLS-2716] - mongodb-database-tools package should break older versions of mongodb-*-tools

New Feature

  • [TOOLS-2667] - Support list of files for put and get subcommands in mongofiles
  • [TOOLS-2668] - Create regex interface for getting files from remote FS in mongofiles

Task

  • [TOOLS-2674] - Clarify contribution guidelines
  • [TOOLS-2700] - Use git tags for triggering release versions
  • [TOOLS-2701] - Log target linux repo in push task

100.1.1

Released 2020-07-31

We are pleased to announce version 100.1.1 of the MongoDB Database Tools.

This release fixes contains a fix for a linux packaging bug and a mongorestore bug related to the convertLegacyIndexes flag.

The Database Tools are available on the MongoDB Download Center. Installation instructions and documentation can be found on docs.mongodb.com/database-tools. Questions and inquiries can be asked on the MongoDB Developer Community Forum. Please make sure to tag forum posts with database-tools. Bugs and feature requests can be reported in the Database Tools Jira where a list of current issues can be found.

Release

Bug

  • [TOOLS-2645] - Check for duplicate index keys after converting legacy index definitions
  • [TOOLS-2683] - Ubuntu 16.04 DB Tools 100.1.0 DEB depends on libcom-err2, should be libcomerr2

100.1.0

Released 2020-07-24

We are pleased to announce version 100.1.0 of the MongoDB Database Tools.

This release officially adds support for MongoDB 4.4. In addition to various bug fixes, it adds support for MongoDB 4.4's new MONGODB-AWS authentication mechanism.

The Database Tools are available on the MongoDB Download Center. Installation instructions and documentation can be found on docs.mongodb.com/database-tools. Questions and inquiries can be asked on the MongoDB Developer Community Forum. Please make sure to tag forum posts with database-tools. Bugs and feature requests can be reported in the Database Tools Jira where a list of current issues can be found.

Build Failure

  • [TOOLS-2604] - integration-4.4-cluster is failing on master
  • [TOOLS-2638] - Test-case failure for mongorestore
  • [TOOLS-2643] - New linux distros missing from repo-config.yaml

Release

Bug

  • [TOOLS-2287] - URI parser incorrectly prints unsupported parameter warnings
  • [TOOLS-2337] - nsInclude does not work with percent encoded namespaces
  • [TOOLS-2366] - ^C isn't handled by mongodump
  • [TOOLS-2494] - mongorestore thorw error "panic: close of closed channel"
  • [TOOLS-2531] - mongorestore hung if restoring views with --preserveUUID --drop options
  • [TOOLS-2596] - DBTools --help links to old Manual doc pages
  • [TOOLS-2597] - swallows errors from URI parsing
  • [TOOLS-2609] - Detached signatures incorrectly appearing in download JSON
  • [TOOLS-2622] - Tools do not build following README instructions
  • [TOOLS-2669] - macOS zip archive structure incorrect
  • [TOOLS-2670] - Troubleshoot IAM auth options errors

New Feature

Task

  • [TOOLS-2363] - Update warning message for "mongorestore"
  • [TOOLS-2476] - Notarize builds for macOS catalina
  • [TOOLS-2505] - Add missing 4.4 Platforms
  • [TOOLS-2534] - Ignore startIndexBuild and abortIndexBuild oplog entries in oplog replay
  • [TOOLS-2535] - commitIndexBuild and createIndexes oplog entries should build indexes with the createIndexes command during oplog replay
  • [TOOLS-2554] - Remove ReplSetTest file dependencies from repo
  • [TOOLS-2569] - Update tools to go driver 1.4.0
  • [TOOLS-2618] - Refactor AWS IAM auth testing code
  • [TOOLS-2628] - Add 3.4 tests to evg
  • [TOOLS-2644] - Update barque authentication
  • [TOOLS-2650] - Create changelog for tools releases

100.0.2

Released 2020-06-04

We are pleased to announce version 100.0.2 of the MongoDB Database Tools.

This release contains several bugfixes. It also adds support for dumping and restoring collections with long names since the 120 byte name limit will be raised to 255 bytes in MongoDB version 4.4.

The Database Tools are available on the MongoDB Download Center. Installation instructions and documentation can be found on docs.mongodb.com/database-tools. Questions and inquiries can be asked on the MongoDB Developer Community Forum. Please make sure to tag forum posts with database-tools. Bugs and feature requests can be reported in the Database Tools Jira where a list of current issues can be found.

Bug

  • [TOOLS-1785] - Typo in mongodump help
  • [TOOLS-2495] - Oplog replay can't handle entries > 16 MB
  • [TOOLS-2498] - Nil pointer error mongodump
  • [TOOLS-2559] - Error on uninstalling database-tools 99.0.1-1 RPM
  • [TOOLS-2575] - mongorestore panic during convertLegacyIndexes from 4.4 mongodump
  • [TOOLS-2593] - Fix special handling of $admin filenames

Task

100.0.1

Released 2020-04-28

We are pleased to announce version 100.0.1 of the MongoDB Database Tools.

This release was a test of our new release infrastructure and contains no changes from 100.0.0.

The Database Tools are available on the MongoDB Download Center. Installation instructions and documentation can be found on docs.mongodb.com/database-tools. Questions and inquiries can be asked on the MongoDB Developer Community Forum. Please make sure to tag forum posts with database-tools. Bugs and feature requests can be reported in the Database Tools Jira where a list of current issues can be found.

Task

  • [TOOLS-2493] - Cut tools 100.0.0 and 100.0.1 GA releases

100.0.0

Released 2020-04-28

We are pleased to announce version 100.0.0 of the MongoDB Database Tools.

This is the first separate release of the Database Tools from the Server. We decided to move to a separate release so we can ship new features and bugfixes more frequently. The new separate release version starts from 100.0.0 to make it clear the versioning is separate from the Server. You can read more about this on the MongoDB blog.

This release contains bugfixes, some new command-line options, and quality of life improvements. A full list can be found below, but here are some highlights:

  • There are no longer restrictions on using --uri with other connection options such as --port and --password as long as the URI and the explicit option don't provide conflicting information. Connection strings can now be specified as a positional argument without the --uri option.
  • The new --useArrayIndexFields flag for mongoimport interprets natural numbers in fields as array indexes when importing csv or tsv files.
  • The new --convertLegacyIndexes flag for mongorestore removes any invalid index options specified in the corresponding mongodump output, and rewrites any legacy index key values to use valid values.
  • A new delete mode for mongoimport. With --mode delete, mongoimport deletes existing documents in the database that match a document in the import file.

The Database Tools are available on the MongoDB Download Center. Installation instructions and documentation can be found on docs.mongodb.com/database-tools. Questions and inquiries can be asked on the MongoDB Developer Community Forum. Please make sure to tag forum posts with database-tools. Bugs and feature requests can be reported in the Database Tools Jira where a list of current issues can be found.

Build Failure

Bug

  • [TOOLS-1493] - Tools crash running help when terminal width is low
  • [TOOLS-1786] - mongodump does not create metadata.json file for views dumped as collections
  • [TOOLS-1826] - mongorestore panic in archive mode when replay oplog failed
  • [TOOLS-1909] - mongoimport does not report that it supports the decimal type
  • [TOOLS-2275] - autoIndexId:false is not supported in 4.0
  • [TOOLS-2334] - Skip system collections during oplog replay
  • [TOOLS-2336] - Wrong deprecation error message printed when restoring from stdin
  • [TOOLS-2346] - mongodump --archive to stdout corrupts archive when prompting for password
  • [TOOLS-2379] - mongodump/mongorestore error if source database has an invalid index option
  • [TOOLS-2380] - mongodump fails against hidden node with authentication enabled
  • [TOOLS-2381] - Restore no socket timeout behavior
  • [TOOLS-2395] - Incorrect message for oplog overflow
  • [TOOLS-2403] - mongorestore hang while replaying last oplog failed in archive mode
  • [TOOLS-2422] - admin.tempusers is not dropped by mongorestore
  • [TOOLS-2423] - mongorestore does not drop admin.tempusers if it exists in the dump
  • [TOOLS-2455] - mongorestore hangs on invalid archive
  • [TOOLS-2462] - Password prompt does not work on windows
  • [TOOLS-2497] - mongorestore may incorrectly validate index name length before calling createIndexes
  • [TOOLS-2513] - Creating client options results in connection string validation error
  • [TOOLS-2520] - Fix options parsing for SSL options
  • [TOOLS-2547] - Installing database tools fails on rhel 7.0
  • [TOOLS-2548] - Installing database tools fails on SLES 15

New Feature

  • [TOOLS-1954] - Support roundtrip of mongoexport array notation in mongoimport
  • [TOOLS-2268] - Add remove mode to mongoimport
  • [TOOLS-2412] - Strip unsupported legacy index options
  • [TOOLS-2430] - mongorestore: in dotted index keys, replace "hashed" with "1"
  • [TOOLS-2459] - Allow --uri to be used with other connection string options
  • [TOOLS-2460] - A connection string can be set as a positional argument
  • [TOOLS-2521] - Add support for the tlsDisableOCSPEndpointCheck URI option
  • [TOOLS-2529] - Mongodump outputs new file format for long collection names

Task

  • [TOOLS-2418] - Remove mongoreplay from mongo-tools
  • [TOOLS-2421] - Maintain test coverage after moving tools tests from server
  • [TOOLS-2438] - Create MSI installer in dist task
  • [TOOLS-2439] - Tools formula included in homebrew tap
  • [TOOLS-2440] - Sign MSI installer
  • [TOOLS-2441] - Update release process documentation
  • [TOOLS-2442] - Automate release uploads
  • [TOOLS-2443] - Generate tarball archive in dist task
  • [TOOLS-2444] - Generate deb packages in dist task
  • [TOOLS-2449] - Create sign task
  • [TOOLS-2464] - Update platform support
  • [TOOLS-2470] - Sign linux packages
  • [TOOLS-2471] - Automate JSON download feed generation
  • [TOOLS-2472] - Automate linux package publishing
  • [TOOLS-2473] - Consolidate community and enterprise buildvariants
  • [TOOLS-2475] - Manually verify tools release
  • [TOOLS-2480] - Generate rpm packages in dist task
  • [TOOLS-2488] - Update package naming and versioning
  • [TOOLS-2493] - Cut tools 100.0.0 and 100.0.1 GA releases
  • [TOOLS-2506] - Update maintainer in linux packages
  • [TOOLS-2523] - Remove Ubuntu 12.04 and Debian 7.1 variants
  • [TOOLS-2536] - ignoreUnknownIndexOptions option in the createIndexes command for servers >4.1.9
  • [TOOLS-2538] - Move convertLegacyIndexKeys() from mongorestore to mongo-tools-common
  • [TOOLS-2539] - Publish linux packages to curator with correct names
  • [TOOLS-2549] - Push GA releases to server testing repo
  • [TOOLS-2550] - Push GA releases to the 4.4 repo
  • [TOOLS-2551] - Split release uploading into per-distro tasks