Changelog¶

Pydantic 2.0 #865 (munrojm)
Revert "Automated dependency upgrades" #862 (rkingsbury)
CI: add changelog template and prevent duplicate GH Action releases #861 (rkingsbury)
Automated dependency upgrades #860 (github-actions[bot])
Update @arosen93 to @Andrew-S-Rosen #859 (Andrew-S-Rosen)

v0.55.0 (2023-09-06)¶

Full Changelog

v0.56.0 (2023-09-06)¶

Full Changelog

Closed issues:

Would the maggma docs be a good place to host MongoDB setup instructions? #845

Merged pull requests:

Automated dependency upgrades #856 (github-actions[bot])
migrate dependencies to setup.py and update CI config #855 (rkingsbury)
Automated dependency upgrades #854 (github-actions[bot])
Fix broken link in README.md #853 (Andrew-S-Rosen)
Create dependabot.yml to update GitHub actions packages #852 (Andrew-S-Rosen)
Remove tests for Python 3.7 since it reached its end-of-life #851 (Andrew-S-Rosen)
Update CI pipeline so repeated commits don't cause concurrent tests #850 (Andrew-S-Rosen)
Add a "Setting up MongoDB" guide to the docs and update README #849 (Andrew-S-Rosen)
CI: use OS-specific requirements in testing #841 (rkingsbury)

v0.54.0 (2023-08-29)¶

Full Changelog

Merged pull requests:

Automated dependency upgrades #848 (github-actions[bot])
JSONStore: enabled reading of MongoDB extended JSON files #847 (rkingsbury)
Automated dependency upgrades #844 (github-actions[bot])

v0.53.1 (2023-08-15)¶

Full Changelog

Merged pull requests:

Aws store botocore fix #843 (tsmathis)
Automated dependency upgrades #842 (github-actions[bot])
CI: small update to auto dependency workflow #840 (rkingsbury)
Automated dependency upgrades #839 (github-actions[bot])

v0.53.0 (2023-08-02)¶

Full Changelog

Merged pull requests:

allow >5GB and turn on multi-part uploads for AWS #829 (kbuma)

v0.52.2 (2023-08-02)¶

Full Changelog

v0.52.1 (2023-08-02)¶

Full Changelog

Merged pull requests:

Allow maggma to be used without Azure #837 (jmmshn)
rm merge-me action #836 (rkingsbury)
Automated dependency upgrades #835 (rkingsbury)

v0.52.0 (2023-07-31)¶

Full Changelog

v0.51.25 (2023-07-27)¶

Full Changelog

Merged pull requests:

Some cleanup: isort, updated classifiers, remove unused kwarg #833 (Andrew-S-Rosen)

v0.51.24 (2023-07-21)¶

Full Changelog

v0.51.23 (2023-07-21)¶

Full Changelog

Closed issues:

database_name of MontyStore doesn't seem to update the name #820

Merged pull requests:

FileStore performance enhancements #824 (rkingsbury)

v0.51.22 (2023-07-21)¶

Full Changelog

Closed issues:

Instantiating a Store from a dictionary representation #825

Merged pull requests:

misc. MontyStore improvements #827 (rkingsbury)

v0.51.21 (2023-07-11)¶

Full Changelog

v0.51.20 (2023-07-11)¶

Full Changelog

Merged pull requests:

Fixe ruamel.yaml dependency #823 (jmmshn)

v0.51.19 (2023-07-11)¶

Full Changelog

Merged pull requests:

Update setup.py #822 (jmmshn)

v0.51.18 (2023-07-10)¶

Full Changelog

Merged pull requests:

Add MontyStore to maggma.stores.__init__ #819 (Andrew-S-Rosen)

v0.51.17 (2023-07-07)¶

Full Changelog

Merged pull requests:

Revert store close apart from S3 #818 (munrojm)

v0.51.16 (2023-07-07)¶

Full Changelog

Merged pull requests:

Fix s3 store collection close handling in resource classes #817 (munrojm)

v0.51.15 (2023-07-06)¶

Full Changelog

Merged pull requests:

Fix collection check #816 (munrojm)

v0.51.14 (2023-07-06)¶

Full Changelog

Merged pull requests:

Check for collection before closing in resources #815 (munrojm)

v0.51.13 (2023-07-06)¶

Full Changelog

Merged pull requests:

Add explicit store close to resources #814 (munrojm)

v0.51.10 (2023-06-27)¶

Full Changelog

v0.51.11 (2023-06-27)¶

Full Changelog

v0.51.12 (2023-06-27)¶

Full Changelog

Merged pull requests:

fix the response field #811 (yang-ruoxi)

v0.51.9 (2023-06-22)¶

Full Changelog

Fixed bugs:

python 3.11 CI test failure with AzureBlobStore #807

Merged pull requests:

add patch method for submission resource #809 (yang-ruoxi)

v0.51.8 (2023-06-14)¶

Full Changelog

Implemented enhancements:

Memray memory profiler support for mrun command line tool #794 (tsmathis)

Closed issues:

MontyStore cannot be used with a pre-existing local DB #796

Merged pull requests:

Fixing bug in azure multi worker test #808 (gpetretto)
Clarify docstring for MontyDB and add missing self.database property #806 (Andrew-S-Rosen)
Add CodeQL workflow for GitHub code scanning #743 (lgtm-com[bot])

v0.51.7 (2023-06-12)¶

Full Changelog

Merged pull requests:

Explicitly close s3 client connections in S3Store #805 (munrojm)

v0.51.6 (2023-06-08)¶

Full Changelog

Merged pull requests:

Use tqdm.auto #795 (utf)

v0.51.5 (2023-06-06)¶

Full Changelog

Merged pull requests:

Disable worker timeouts by default #793 (munrojm)

v0.51.4 (2023-06-02)¶

Full Changelog

Merged pull requests:

modify JSONStore file creation #792 (gpetretto)

v0.51.3 (2023-05-29)¶

Full Changelog

v0.51.2 (2023-05-29)¶

Full Changelog

Merged pull requests:

Add orjson options in JSONStore #791 (gpetretto)
Implementation of an AzureBlobStore for Azure blobs #790 (gpetretto)

v0.51.1 (2023-05-22)¶

Full Changelog

Merged pull requests:

Add ruamel-yaml as a dependency #789 (sivonxay)

v0.51.0 (2023-05-22)¶

Full Changelog

Merged pull requests:

Create a MultiStore object and a Store-like object to access it #787 (sivonxay)

v0.50.4 (2023-04-28)¶

Full Changelog

Merged pull requests:

Update MongoStore count method #785 (munrojm)

v0.50.3 (2023-02-17)¶

Full Changelog

Merged pull requests:

Remove extra heartbeats from workers #779 (munrojm)

v0.50.2 (2023-02-17)¶

Full Changelog

Merged pull requests:

Pydantic CLI settings #778 (munrojm)

v0.50.1 (2023-02-16)¶

Full Changelog

Merged pull requests:

Remove stray print in worker debug #777 (munrojm)

v0.50.0 (2023-02-16)¶

Full Changelog

Merged pull requests:

Overhaul distributed framework and add RabbitMQ support #776 (munrojm)

v0.49.18 (2023-02-13)¶

Full Changelog

Merged pull requests:

Add more heartbeat pings from worker #775 (munrojm)

v0.49.17 (2023-01-30)¶

Full Changelog

Merged pull requests:

Remove default sorting from API #770 (munrojm)

v0.49.16 (2023-01-23)¶

Full Changelog

Merged pull requests:

Query pipeline out of memory fix #767 (munrojm)

v0.49.15 (2023-01-23)¶

Full Changelog

Merged pull requests:

Fix server-side API sorting #766 (munrojm)

v0.49.14 (2023-01-18)¶

Full Changelog

Merged pull requests:

Fix S3 store queries in API #761 (munrojm)

v0.49.13 (2023-01-10)¶

Full Changelog

Merged pull requests:

Aggregation pipelines in resource classes #759 (munrojm)

v0.49.12 (2023-01-09)¶

Full Changelog

Merged pull requests:

Add default sort parameter to MongoStore #758 (munrojm)

v0.49.11 (2022-12-15)¶

Full Changelog

Merged pull requests:

Async to sync for fastapi funcs #750 (munrojm)

v0.49.10 (2022-12-07)¶

Full Changelog

Merged pull requests:

Enable disk use in mongo find #749 (munrojm)

v0.49.9 (2022-11-01)¶

Full Changelog

Merged pull requests:

Parse datetime with dateutil #741 (munrojm)

v0.49.8 (2022-10-25)¶

Full Changelog

v0.49.7 (2022-10-25)¶

Full Changelog

Merged pull requests:

FileStore: fix metadata overwriting path #736 (rkingsbury)
JSONStore: fix last_updated serialization problem #735 (rkingsbury)

v0.49.6 (2022-10-21)¶

Full Changelog

Merged pull requests:

Default sort on _id for determinacy #732 (munrojm)

v0.49.5 (2022-09-30)¶

Full Changelog

Merged pull requests:

Up manager timeout #718 (munrojm)

v0.49.4 (2022-09-28)¶

Full Changelog

Merged pull requests:

Up worker timeout #717 (munrojm)

v0.49.3 (2022-09-27)¶

Full Changelog

Merged pull requests:

Update high water mark #716 (munrojm)

v0.49.2 (2022-09-27)¶

Full Changelog

Merged pull requests:

Fix stalling in distributed code #715 (munrojm)

v0.49.1 (2022-09-26)¶

Full Changelog

Merged pull requests:

Send proper exit message to workers #714 (munrojm)

v0.49.0 (2022-09-23)¶

Full Changelog

Merged pull requests:

Enhance distributed builder code #711 (munrojm)

v0.48.1 (2022-09-02)¶

Full Changelog

Merged pull requests:

Add ssh_tunnel option to GridFSStore #707 (utf)

v0.48.0 (2022-08-04)¶

Full Changelog

Merged pull requests:

Proposal: remove Drone class #669 (rkingsbury)

v0.47.6 (2022-08-04)¶

Full Changelog

Merged pull requests:

Docs: add mermaid diagram support #677 (rkingsbury)

v0.47.5 (2022-07-26)¶

Full Changelog

Merged pull requests:

Add pymongo timeout context to queries #691 (munrojm)

v0.47.4 (2022-07-25)¶

Full Changelog

Merged pull requests:

Ensure all fields are properly sanitized #690 (munrojm)

v0.47.3 (2022-06-07)¶

Full Changelog

Merged pull requests:

Fix header processing #679 (munrojm)

v0.47.2 (2022-05-27)¶

Full Changelog

Merged pull requests:

Docs updates: add FileStore and misc edits #668 (rkingsbury)

v0.47.1 (2022-05-24)¶

Full Changelog

Merged pull requests:

Fix gridfs URI store #667 (utf)

v0.47.0 (2022-05-23)¶

Full Changelog

Merged pull requests:

FileStore: a Store for files on disk #619 (rkingsbury)

v0.46.2 (2022-05-23)¶

Full Changelog

Merged pull requests:

allow s3 resource kwargs #665 (jmmshn)

v0.46.1 (2022-04-21)¶

Full Changelog

Merged pull requests:

Prefix fields input for read resource key endpoint #636 (munrojm)

v0.46.0 (2022-04-19)¶

Full Changelog

Merged pull requests:

S3 store and resource additions #635 (munrojm)

v0.45.1 (2022-04-18)¶

Full Changelog

Merged pull requests:

minor bug fix in remove_docs #626 (jmmshn)

v0.45.0 (2022-04-14)¶

Full Changelog

Merged pull requests:

Changes to core query operators and API #620 (munrojm)

v0.44.5 (2022-04-12)¶

Full Changelog

Merged pull requests:

JSONStore: file_writable -> read_only #625 (rkingsbury)

v0.44.4 (2022-04-12)¶

Full Changelog

Merged pull requests:

JSONStore: write file on init, add descriptive KeyError, add tests #624 (rkingsbury)

v0.44.3 (2022-04-11)¶

Full Changelog

Merged pull requests:

MemoryStore: fix groupby ignoring properties #621 (rkingsbury)

v0.44.2 (2022-04-05)¶

Full Changelog

Merged pull requests:

Force post-process method to take in query params #618 (munrojm)

v0.44.1 (2022-03-08)¶

Full Changelog

Merged pull requests:

added localhost test for MongoURIStore #595 (jmmshn)

v0.42.0 (2022-03-07)¶

Full Changelog

v0.43.0 (2022-03-07)¶

Full Changelog

v0.44.0 (2022-03-07)¶

Full Changelog

Merged pull requests:

Remove python3.6 support and fix tests #579 (munrojm)
typo #576 (jmmshn)

v0.41.1 (2022-03-05)¶

Full Changelog

Merged pull requests:

mongoclient_kwargs #575 (jmmshn)
change cleint -> resource in aws tests #574 (jmmshn)

v0.41.0 (2022-02-15)¶

Full Changelog

Merged pull requests:

Add header processing abilities to certain Resource classes #569 (munrojm)

v0.40.0 (2022-02-10)¶

Full Changelog

Merged pull requests:

Add authsource option for mongo and gridfs stores #567 (utf)

v0.39.1 (2022-01-27)¶

Full Changelog

Fixed bugs:

Single import-dependence on pynng causes M1 Mac install error #528

Merged pull requests:

Add boto3 to required packages #544 (munrojm)

v0.39.0 (2022-01-26)¶

Full Changelog

Merged pull requests:

Replace pynng functionality with pyzmq #543 (munrojm)
Encode _ as -- in metadata when using S3Store.write_doc_to_s3 #532 (mkhorton)

v0.38.1 (2021-12-10)¶

Full Changelog

Merged pull requests:

Add ability to input index hints to count method #524 (munrojm)

v0.38.0 (2021-12-09)¶

Full Changelog

Merged pull requests:

Fix issue with close and MongoStore and update _collection attribute #523 (munrojm)

v0.37.0 (2021-12-07)¶

Full Changelog

Merged pull requests:

Revert broken MongoStore auth testing #522 (munrojm)
Fix authentication for MongoStore to work with pymongo==4.0 #521 (munrojm)

v0.36.0 (2021-12-06)¶

Full Changelog

Merged pull requests:

Added on-disk MongoDB compatible MontyStore #514 (utf)

v0.34.0 (2021-12-01)¶

Full Changelog

v0.35.0 (2021-12-01)¶

Full Changelog

Merged pull requests:

Changes to accommodate new pymongo #517 (munrojm)

v0.33.2 (2021-12-01)¶

Full Changelog

Merged pull requests:

Patch mongo store connect methods #516 (munrojm)

v0.33.1 (2021-12-01)¶

Full Changelog

Merged pull requests:

Patch memory store connect method #515 (munrojm)

v0.33.0 (2021-11-30)¶

Full Changelog

Merged pull requests:

MongoDB hint support #513 (munrojm)

v0.32.3 (2021-11-25)¶

Full Changelog

Merged pull requests:

Added option for writable JSONStores (for single JSON files only). #507 (davidwaroquiers)

v0.32.2 (2021-11-23)¶

Full Changelog

Merged pull requests:

Alter sorting query operator to take comma delimited string #510 (munrojm)

v0.32.1 (2021-11-10)¶

Full Changelog

Merged pull requests:

Default to yaml full loader to fix tests #505 (munrojm)
Add GridFSURIStore with support for URI connections #504 (utf)

v0.32.0 (2021-10-11)¶

Full Changelog

Merged pull requests:

Update sorting query operator to take multiple fields #500 (munrojm)
Change to S3Store serialization behavior in update() and other Mongolike Store changes #493 (sivonxay)

v0.31.0 (2021-08-14)¶

Full Changelog

Merged pull requests:

Add from_launchpad_file classmethod to MongoStore #476 (sivonxay)

v0.30.4 (2021-08-04)¶

Full Changelog

Merged pull requests:

Fix documentation in aggregation and sparse fields #469 (munrojm)

v0.30.3 (2021-08-04)¶

Full Changelog

Merged pull requests:

Enable enhanced documentation #468 (munrojm)

v0.30.2 (2021-07-09)¶

Full Changelog

Merged pull requests:

orjson added to setup.py #465 (munrojm)

v0.30.1 (2021-07-09)¶

Full Changelog

Merged pull requests:

Switch from monty to orjson for serialization #464 (munrojm)

v0.30.0 (2021-07-06)¶

Full Changelog

Merged pull requests:

Enable monty encoded direct responses #463 (munrojm)

v0.29.4 (2021-06-23)¶

Full Changelog

Merged pull requests:

BugFix: Manual distinct in MongoStore not using Criteria #461 (shyamd)

v0.29.3 (2021-06-21)¶

Full Changelog

Merged pull requests:

Sort query and query operator meta bug fixes #453 (munrojm)

v0.29.2 (2021-06-18)¶

Full Changelog

Merged pull requests:

Fix API Sanitizing MSONable types in combined types #454 (shyamd)

v0.29.1 (2021-06-15)¶

Full Changelog

Merged pull requests:

Switch from classic bson to pymongo bson #452 (shyamd)

v0.29.0 (2021-06-08)¶

Full Changelog

Merged pull requests:

Maggma API additions #448 (munrojm)

v0.28.1 (2021-06-08)¶

Full Changelog

Closed issues:

Indescriptive error when not specifying any builders in CLI #446
Add port auto-negotiation #445

Merged pull requests:

New release wflow #450 (shyamd)
Ensure Store.name is a property #449 (utf)

v0.28.0 (2021-05-26)¶

Full Changelog

Merged pull requests:

Updates the CLI Runner #447 (shyamd)

v0.27.0 (2021-05-12)¶

Full Changelog

Closed issues:

Python 3.6 compatability #336

Merged pull requests:

Fix aws module import #435 (utf)
coverage #430 (jmmshn)
Update AWS Bucket Detection #429 (jmmshn)
Add Object Hash to S3Store #427 (jmmshn)
Rebuild API module #423 (shyamd)
updated documentaion. #419 (jmmshn)
Revert "Bump ipython from 7.16.1 to 7.21.0" #406 (shyamd)
update gridfs store #381 (gpetretto)

v0.26.0 (2021-01-16)¶

Full Changelog

Merged pull requests:

No Progress bars #382 (shyamd)

v0.25.0 (2020-12-04)¶

Full Changelog

Closed issues:

FEATURE: Jupyter Commands #276

Merged pull requests:

Python 3.6 Compatibility #352 (shyamd)
Automatically parse the dbname from the URI #350 (jmmshn)
Setup: msgpack-python was renamed to msgpack #344 (jan-janssen)
Ensure MongoStore can safely continue updating when documents are too large #338 (shyamd)

v0.24.2 (2020-11-17)¶

Full Changelog

Merged pull requests:

Fix array unwrapping in distinct #335 (shyamd)

v0.24.1 (2020-11-17)¶

Full Changelog

Closed issues:

mrun failure with 'dict' object has no attribute 'connect' #316
FEATURE: Serialized SSH Tunnel #290

Merged pull requests:

Fix Distinct in MongoStore #332 (shyamd)
Direct passing of AWS login to S3Store #326 (jmmshn)
Wrap SSHTunnelForward and make it MSONable #320 (shyamd)

v0.24.0 (2020-11-02)¶

Full Changelog

Merged pull requests:

Small fix to make sure searchable_fields are updated #303 (jmmshn)

v0.23.3 (2020-09-23)¶

Full Changelog

v0.23.2 (2020-09-23)¶

Full Changelog

v0.23.1 (2020-09-21)¶

Full Changelog

Closed issues:

FEATURE: Python file runner #277

v0.23.0 (2020-09-14)¶

Full Changelog

Closed issues:

Separate out S3 Object reference keys from search keys #206

Merged pull requests:

Add custom source loading #278 (shyamd)
Inject metadata via fields rather than by indicies #265 (shyamd)

v0.22.3 (2020-08-26)¶

Full Changelog

Merged pull requests:

added context manager for stores #258 (jmmshn)

v0.22.2 (2020-08-21)¶

Full Changelog

Merged pull requests:

Minor bug fixes to S3Store #253 (jmmshn)

v0.22.1 (2020-08-11)¶

Full Changelog

Merged pull requests:

accept int as sort keys instead of Sort() in .query() and .groupby() #241 (rkingsbury)
Update setup.py #225 (jmmshn)

v0.22.0 (2020-07-16)¶

Full Changelog

Merged pull requests:

Ensure Metadata in Documents from GridFS #222 (shyamd)
Projection_Builder tests #213 (acrutt)
[WIP] Proper multithreading and msgpack fix #205 (jmmshn)
Fix projection_builder.update_targets() #179 (acrutt)

v0.21.0 (2020-06-22)¶

Full Changelog

Merged pull requests:

Reconstruct metadata from index in S3 Store #182 (jmmshn)
MapBuilder retry_failed Fix #180 (acrutt)
MapBuilder retry_failed bug #111 (acrutt)

v0.20.0 (2020-05-02)¶

Full Changelog

Merged pull requests:

Initial Drone Implementation #145 (wuxiaohua1011)
parallel s3 store wrting #130 (jmmshn)
Make GridFSStore query check files store first. #128 (munrojm)

v0.19.1 (2020-04-06)¶

Full Changelog

v0.19.0 (2020-04-06)¶

Full Changelog

Closed issues:

ISSUE: newer_in method incompatible with GridFSStore #113

Merged pull requests:

Fix async #129 (shyamd)
small fixes #115 (jmmshn)
Store updates #114 (jmmshn)
[WIP] Add EndpointCluster and ClusterManager to maggma #66 (wuxiaohua1011)

v0.18.0 (2020-03-23)¶

Full Changelog

Merged pull requests:

Amazon S3 store update #110 (munrojm)

v0.17.3 (2020-03-18)¶

Full Changelog

v0.17.2 (2020-03-13)¶

Full Changelog

v0.17.1 (2020-03-12)¶

Full Changelog

Merged pull requests:

Various Bug Fixes #109 (shyamd)
Addition of Projection Builder #99 (acrutt)
Fix issues with last_updated in MapBuilder #98 (shyamd)
autonotebook for tqdm #97 (shyamd)

v0.16.1 (2020-01-28)¶

Full Changelog

v0.16.0 (2020-01-28)¶

Full Changelog

Closed issues:

Onotology generation from builder #59

Merged pull requests:

Add MongoURIStore #93 (shyamd)
Update distinct to be more like mongo distinct #92 (shyamd)
Add count to maggma store #86 (shyamd)

v0.15.0 (2020-01-23)¶

Full Changelog

Closed issues:

Builder Reporting #78
ZeroMQ based multi-node processing #76
Add time limits to process_item? (Possibly just in MapBuilder?) #45

Merged pull requests:

[WIP] Builder Reporting #80 (shyamd)
Updated GroupBuilder #79 (shyamd)
New Distributed Processor #77 (shyamd)

v0.14.1 (2020-01-10)¶

Full Changelog

v0.14.0 (2020-01-10)¶

Full Changelog

Closed issues:

Preserve last_updated for MapBuilder #58
Move away from mpi4py #51
Run serial processor directly from builder #48
Update while processing #42
Running JSONStore.connect() multiple times leads to undefined behavior #40
get_criteria directly invokes mongo commands #38
Cursor timeouts common #35
Possible solution to "stalled" Runner.run ? #29

Merged pull requests:

Release Workflow for Github #75 (shyamd)
Documentation #74 (shyamd)
Reorg code #69 (shyamd)
Updates for new monitoring services #67 (shyamd)
fix GridFSStore #64 (gpetretto)
Massive refactoring to get ready for v1.0 #62 (shyamd)
Bug Fixes #61 (shyamd)
GridFSStore bug fix #60 (munrojm)
Fix Store serialization with @version #57 (mkhorton)
Update builder to work with new monty #56 (mkhorton)

v0.13.0 (2019-03-29)¶

Full Changelog

Merged pull requests:

Add timeout to MapBuilder, store process time #54 (mkhorton)
Can update pyyaml req? #50 (dwinston)
Concat store #47 (shyamd)

v0.12.0 (2018-11-19)¶

Full Changelog

v0.11.0 (2018-11-01)¶

Full Changelog

Merged pull requests:

Better printing of validation erorrs #46 (mkhorton)
Updates to JointStore and MapBuilder #44 (shyamd)

v0.9.0 (2018-10-01)¶

Full Changelog

Closed issues:

Non-obvious error message when trying to query a Store that hasn't been connected #41
Criteria/properties order of MongoStore.query #37
tqdm in Jupyter #33
query args order #31

Merged pull requests: