Navigation

Release Notes

  • Supports selecting read preference, read tags, and max staleness through the storage configuration for Atlas Cluster stores.
  • Rejects commands sent with a Versioned API set.
  • Enables the count parameter in the Data Lake $collStats aggregation stage.
  • No longer permits $collStats in $facet sub-pipelines.
  • Enforces maximum document size for $facet after processing each item.
  • Improves performance for $match stages.
  • Improves error messaging.
  • Improves stability and performance.
  • Includes improved support for Parquet.
  • Supports M0, M2, & M5 Atlas clusters as data sources.
  • Adds regex pattern matching option for wildcard collections from Atlas Clusters.
  • Includes updated error messages for query execution limit.
  • Generates storage configuration automatically for the first time after user authentication.
  • Returns connection ID through the hello command.
  • Supports $geoNear on Atlas Data Lake collections that span multiple Atlas clusters.
  • Includes various performance improvements.
  • Includes improved error messages for terminated queries.
  • Includes new onboarding and storage configuration interface.
  • Improved SQL schema error message.
  • Support query pushdown to collections comprised of multiple Atlas collections.
  • Improves stability and performance.
  • Adds a new $sql formatVersion to reduce the data size of the result set.
  • Improves performance of $lookup.
  • Adds "verbosity": "queryPlannerExtended" support to the explain command to filter out non-matching partitions.
  • Adds support for $$NOW.
  • Reports Atlas Data Lake as MongoDB version 4.4 to tools.
  • Adds support for the background option on the $out to Atlas aggregation stage.
  • Includes stability and performance improvements.
  • Adds {background: true} option, which allows queries to run in the background for $out to S3 stage.
  • Introduces $queryHistory aggregation stage to view past queries.
  • Includes various performance and stability improvements.
  • Supports Parquet, CSV, and TSV formats for $out to S3.
  • Adds a rolling limit for cursors.
  • Improves error messages for commands that cannot be parsed.
  • Supports defaultFormat for files in publicly accessible URLs in HTTP stores.
  • Limits the number of simultaneous queries to 30 per Data Lake.
  • Supports bzip2 compression format.
  • Supports comment option for the aggregate command.
  • Includes various performance and stability improvements.
  • Supports killOp command for terminating a long-running query.
  • Adds configuration for maximum number of wildcard collections for S3 data stores.
  • Improves $out to S3 write performance.
  • Includes general performance and stability improvements.
  • Adds correlationID to the $currentOp output.
  • Includes general performance and stability improvements.
  • Relaxes $out S3 region requirement.
  • Includes improved storage configuration error messages.
  • Includes general performance and stability improvements.
  • Supports $collStats aggregation pipeline stage.
  • Includes performance optimizations for ORC files.
  • Includes general performance and stability improvements.
  • Adds support for the skip and limit fields to the count() command.
  • Adds storageValidateConfig command to validate your Data Lake storage configuration.
  • Includes bug fixes and performance improvements.
  • Includes general performance and stability improvements.
  • Automates storage configuration generation for newly created Atlas Data Lakes.
  • Allows write partitioning-aware data to S3 using the $out in Atlas Data Lake.
  • Fixes stability issues.
  • Improves performance.
  • Supports the $currentOp stage so that you can monitor query progress on long-running queries.
  • Updates the isodate attribute to accept additional formats.
  • Refreshes the metadata catalog when you use Storage Configuration commands.
  • Includes various performance and stability improvements.
  • Supports filename field references for $out.
  • Supports $toString in $out to S3.
  • Supports optionally granting Atlas Data Lake write access to S3 buckets, enabling use of $out semantics to write directly to those buckets.
  • Adds incremental store, database, collection, and view commands for storage configuration management.
  • Limits collections returned for wildcard collections to 1,000.
  • Updates the storage configuration format.
  • Supports cross-database $lookup queries.
  • Supports lowercase and uppercase file extensions.
  • Template segments now support dot-separated attribute names that correspond to nested fields.
  • Allows the defaultFormat to be specified without a leading dot.
  • Supports filtering based on stripes for files in ORC format.
  • Allows query attributes to be extracted after the first stage.
  • Includes several performance and stability improvements.

  • Supports partition definition for the following:

    • epoch_secs, which is seconds since the Unix Epoch
    • epoch_millis, which is milliseconds since the Unix Epoch
    • UUID, which is binary subtype 4
  • Includes several performance and stability improvements.
  • Adds support for reading Apache ORC files.
  • Supports filtering partitions by Parquet file row group statistics.
  • Supports ObjectIds in the path when specifying partition databases.<database>.<collection>.[n].definition.
  • Returns an error if a query produces a document larger than 16 MiB.
  • The $indexStats stage now produces an empty list of indexes instead of an error.
  • Supports $out to S3 storage format in JSON.
  • $match now implicitly treats all terms as conjunctions.
  • No longer parses empty files.
  • Fixes an issue that caused the {$match: {$expr: {$and: []}}} expression to terminate the connection.
  • Allows nested fields in partition definitions.
  • No longer enumerates directories on S3 when a single subdirectory containing all the partitions matching the query is identified.
  • Fixes an issue where the new storage configuration did not appear on the issuing connection after running setStorageConfig.
  • Adds support for the getLastError database command.
  • Fixes a bug with how union types are handled in Avro.
  • Supports $out aggregation pipeline stage to S3.
  • listIndexes now always returns an empty list.
  • Translates dot-delimited CSV and TSV keys into subdocuments.
  • Storage configuration error message now includes a link to the documentation.
  • Supports the XLSX file format.
  • Includes the correlation ID in query execution error messages.
  • Returns an error to the client when the cursor storage limit is reached.
  • Returns an error to the client on the last getMore if the cursor storage limit is exceeded.
  • Supports listCommands. For example: db.runCommand({"listCommands": 1})
  • Includes partition size information in the output of explain().
  • Returns the first batch of cursor results more quickly.
  • Improves performance of $lookup when combined with $unwind.
  • Automatically supports SCRAM-SHA-1 credentials without requiring drivers to specify this authentication mechanism.
  • Provides a descriptive error message when the file format is unknown.
  • Provides additional validation on setStorageConfig.

Initial public beta release of Atlas Data Lake.

© MongoDB, Inc 2008-present. MongoDB, Mongo, and the leaf logo are registered trademarks of MongoDB, Inc.

Give Feedback

On this page

  • 2021 Releases
  • 2020 Releases
  • 2019 Releases