MongoDB grows up | InfoWorld

Once I rejoined MongoDB in 2021, I bought to listen to all of the outdated jokes rehashed. You understand, about MongoDB being “internet scale,” about dropping knowledge, about solely being finally constant, and so forth. The online scale video is humorous; the opposite statements have largely been incorrect because the day they had been written. For instance, MongoDB has at all times been strongly constant. The contentions that had some semblance of fact have turn out to be outdated with every MongoDB launch. As Senior Developer Advocate Mark Smith notes, “All the things you realize about MongoDB is incorrect.”

In fact I’d say that. I work for MongoDB, in any case.

Even so, I feel it’s worthwhile to gut-check our assumptions. For instance, for years we had been informed that enterprises couldn’t change Oracle Database or SQL Server with PostgreSQL. For a lot of workloads, that’s merely not true immediately and virtually definitely wasn’t as “true” earlier than as some would have had us suppose. Though PostgreSQL has at all times had an incredible group, it has additionally had a refrain of critics. In the meantime, each main cloud supplier has a PostgreSQL database service. Going additional, in 2021 AWS launched Babelfish, an open supply mission that makes it easy to drop in PostgreSQL to functions written for SQL Server.

In like method, there’s a cause that each main cloud supplier provides MongoDB in some kind and that the database has been downloaded extra instances up to now 12 months than within the earlier 12 years mixed (for a grand whole of 265 million downloads so far). Each PostgreSQL and MongoDB have made dramatic positive aspects in recognition relative to Oracle and SQL Server.

I don’t wish to fanboy this text. However for those who’ll indulge me, I’d like to catch you up on a MongoDB you won’t know and end with a suggestion that simply would possibly shock you: MongoDB now leads the {industry} in safety, given the discharge of Queryable Encryption.

Atomicity, transactions, and so forth.

I left MongoDB in 2014, proper earlier than the corporate hit overdrive on updates to the core database. The corporate had at all times been a developer darling as a result of its comfort, however round this time MongoDB introduced the acquisition of WiredTiger, which paved the way in which for document-level concurrency management and compression, beginning in MongoDB 3.0 (WiredTiger as an choice) and evolving with MongoDB 3.2 (WiredTiger because the default).

A lot of the work of deeply integrating WiredTiger into MongoDB occurred in 2015, establishing a gentle drumbeat of database enhancements for the subsequent few years, with one in every of my absolute favorites—multi-document ACID transactions—arriving in MongoDB 4.0. As MongoDB cofounder Eliot Horowitz wryly wrote in 2018, “MongoDB drops ACID,” and the MongoDB world was by no means fairly the identical thereafter. In MongoDB 5.0, the corporate launched a versioned API that allowed builders to improve the database with out having to vary their software, time sequence performance, a brand new serverless providing, stay resharding, and extra.

Most not too long ago, at MongoDB World, the corporate introduced quite a lot of issues to make builders’ lives simpler: Atlas Information API, serverless situations, Atlas CLI, and extra. For me, the 2 most attention-grabbing thematic bulletins had been within the areas of analytics and safety. Oh, and open supply.

Analytics, in MongoDB’s world, are all about enabling builders to construct higher apps, not about knowledge analysts doing offline evaluation. In immediately’s world, the necessity for a real-time view of the enterprise pushes knowledge evaluation and reporting wants nearer to the functions that generate the information. MongoDB clearly acknowledged this rising want and introduced a number of new methods to make working analytics towards operational knowledge simple, together with a brand new SQL interface, Atlas Analytics Node Tiers, Atlas Information Federation, and Atlas Information Lake.

Even so, it strikes me that the corporate’s key announcement within the space of making use of analytics to real-time knowledge was Columnstore Indexing. Since columnar codecs are perfect for working analytical workloads, this indexing choice makes it simple for builders to maintain paperwork in the fitting mannequin for his or her functions with out transferring the information, and execute performant analytical queries towards that knowledge in actual time for his or her functions.

If all this comes as a shock to these within the “MongoDB is internet scale” camp, Queryable Encryption is a fair larger shocker.

Upping the ante on knowledge safety

Nothing that MongoDB (or any database firm) releases can be of a lot use if it couldn’t match options and performance with safety. MongoDB has lengthy supplied glorious safety, however the introduction of structured encryption for field-level encryption strikes issues to a different stage. Most databases have discovered methods to safe knowledge at relaxation or in movement however fail to safe knowledge whereas in use when it’s susceptible to insider entry and energetic database breaches. Enter field-level encryption. Subject-level encryption protects knowledge in reminiscence and on disk on the server. It’s the best stage of safety for breaches, but it surely has a draw back: It doesn’t permit for wealthy, expressive querying of encrypted knowledge. Sure, you are able to do actual equality matches, however it’s important to use deterministic encryption.

Good, however not practically sufficient.

Researchers have been engaged on this downside since 2001, however this week MongoDB introduced the first-ever commercially accessible, structured encryption mannequin, referred to as Queryable Encryption. With such structured encryption MongoDB can rework the encrypted area in a cryptographically safe manner such that it will probably retailer nameless metadata permitting expressive and environment friendly queries to be carried out. For instance, structured encryption permits a developer to construct a financial institution software that may discover transactions utilizing a variety of dates or greenback quantities for fraud investigation.

That is best-in-industry stuff and doesn’t depart MongoDB’s developer group behind. In brief, MongoDB’s use of Queryable Encryption helps builders preserve their concentrate on constructing partaking, data-driven functions whereas assembly the {industry}’s most demanding knowledge privateness challenges. No PhD in cryptography required.

This may be attention-grabbing in and of itself, however MongoDB took an particularly noteworthy angle with Queryable Encryption: It is going to be 100% open. As Porter declared in his keynote, “We can be publishing the code, the algorithms, and the mathematics behind it as a result of we consider in white-box safety, not black-box safety.”

This may occasionally come as a shock to those that nonetheless carp on MongoDB’s license change in 2019. (Builders don’t appear to thoughts, given greater priorities.) But it surely shouldn’t. MongoDB is a contributor to Apache Lucene, releases WiredTiger below an open supply license, and in addition provides its Realm cell knowledge retailer as open supply. It’s simple to color firms in binary, but it surely’s often incorrect, as on this case.

All of this can be a good distance of claiming that maybe it’s time to hit “refresh” in your views on MongoDB. No, it’s not going to be the fitting knowledge platform for all your workloads. Nothing is. But it surely’s good to make that call primarily based on present actuality, not outdated myths.