ZeroMQ
Developer(s) | iMatix |
---|---|
Stable release | 4.3.5[1] / 9 October 2023; 10 months ago (9 October 2023) |
Repository |
|
Written in | C++ |
Platform | Cross-platform |
Type | Message queue, concurrency framework |
License | MPL-2.0[2] |
Website | zeromq |
ZeroMQ (also spelled ØMQ, 0MQ or ZMQ) is an asynchronous messaging library, aimed at use in distributed or concurrent applications. It provides a message queue, but unlike message-oriented middleware, a ZeroMQ system can run without a dedicated message broker; the zero in the name is for zero broker.[3] The library's API is designed to resemble Berkeley sockets.
ZeroMQ is developed by a large community of contributors, founded by iMatix, which holds the domain name and trademarks. There are third-party bindings for many popular programming languages.
Technology
The ZeroMQ API provides sockets (a kind of generalization over the traditional IP and Unix domain sockets), each of which can represent a many-to-many connection between endpoints. Operating with a message-wise granularity, they require that a messaging pattern be used, and are particularly optimized for that kind of pattern.
The basic ZeroMQ patterns are:
- Request–reply
- Connects a set of clients to a set of services. This is a remote procedure call and task distribution pattern.
- Publish–subscribe
- Connects a set of publishers to a set of subscribers. This is a data distribution pattern.
- Push–pull (pipeline)
- Connects nodes in a fan-out / fan-in pattern that can have multiple steps, and loops. This is a parallel task distribution and collection pattern.
- Exclusive pair
- Connects two sockets in an exclusive pair. (This is an advanced low-level pattern for specific use cases.)
Each pattern defines a particular network topology. Request-reply defines a so-called "service bus", publish-subscribe defines a "data distribution tree", and push-pull defines "parallelised pipeline". All the patterns are deliberately designed in such a way as to be infinitely scalable and thus usable on Internet scale.[4]
Any message through the socket is treated as an opaque blob of data. Delivery to a subscriber can be automatically filtered by the blob leading string. Available message transports include TCP, PGM (reliable multicast), inter-process communication (IPC) and inter-thread communication (ITC).
The ZeroMQ core library performs very well due to its internal threading model, and can outperform conventional TCP applications in terms of throughput by utilizing an automatic message batching technique.[5][6]
ZeroMQ implements ZMTP, the ZeroMQ Message Transfer Protocol.[7] ZMTP defines rules for backward interoperability, extensible security mechanisms, command and message framing, connection metadata, and other transport-level functionality. A growing number of projects implement ZMTP directly as an alternative to using the full ZeroMQ implementations.[8]
History
iMatix CEO Pieter Hintjens registered the zeromq.org domain in May 2007 and started the ZeroMQ project together with Martin Sustrik, who was its architect and lead developer until December 2011.
On March 30, 2010, Hintjens announced that iMatix (the original designer of Advanced Message Queuing Protocol) would leave the AMQP workgroup and did not plan to support AMQP/1.0 in favor of the significantly simpler and faster ZeroMQ.[9][10]
In 2011, CERN was investigating ways to unify middleware solutions used to operate CERN accelerators. The CERN study compared two open source implementations of CORBA, Ice, Thrift, ZeroMQ, YAMI4,[11] RTI, and Qpid (AMQP) and scored ZeroMQ highest, in part for its versatility, including its easy adaptability to the LynxOS.[6]
At the start of 2012, two of the original developers forked ZeroMQ as Crossroads I/O.[12][13] Martin Sustrik has started nanomsg,[14] a rewrite of the ZeroMQ core library.[15]
In August 2012, Dongmin Yu announced his pure Java conversion of ZeroMQ, JeroMQ.[16] This has inspired further full-native ports of ZeroMQ, such as NetMQ for C#[17] and zmq.rs for Rust.[18]
In March 2013, Pieter Hintjens announced a new draft of the ZMTP wire-level protocol bringing extensible security mechanisms to ZeroMQ.[19] Martin Hurton implemented the CurveZMQ authentication and encryption mechanism[20] in the core library shortly afterwards.
In 2016, long-time ZeroMQ developer Garrett D'Amore forked Nanomsg to create project NNG (Nanomsg Next Generation).[21]
Development process
The ZeroMQ community mostly uses the Collective Code Construction Contract (C4)[22] as a development contract. C4 is inspired by Wikipedia processes and GitHub's fork + pull request model. It focuses on making it simpler for new contributors to participate and reducing dependency on older contributors.
See also
References
- ^ "Release 4.3.5". 9 October 2023. Retrieved 20 October 2023.
- ^ "ØMQ Licensing". Retrieved 8 June 2023.
- ^ "Get started".
- ^ "Scalability Layer Hits the Internet Stack". Archived from the original on 2019-05-28. Retrieved 2013-09-04.
- ^ "How come ØMQ has higher throughput than TCP although it's built on top of TCP?". ZeroMQ FAQ. Retrieved 8 June 2013.
- ^ a b "Middleware Trends And Market Leaders 2011". Retrieved 8 June 2013.
- ^ "ZeroMQ Message Transfer Protocol". Retrieved 8 June 2013.
- ^ "GitHub Search: ZMTP". GitHub. Retrieved 8 June 2013.
- ^ "iMatix will end OpenAMQ support by 2011". openamq-dev maillist. Archived from the original on 2016-03-05. Retrieved 5 September 2018.
- ^ "What is wrong with AMQP (and how to fix it)". iMatix Corporation. Retrieved 14 July 2012.
- ^ "Inspirel YAMI4". Retrieved 14 July 2012.
- ^ "ZeroMQ and Crossroads I/O: Forking over trademarks". LWN.net. Retrieved 14 July 2012.
- ^ "Crossroads I/O". Retrieved 14 July 2012.
- ^ "nanomsg". Retrieved 8 June 2013.
- ^ "Why should I [sic] have written ZeroMQ in C, not C++".
- ^ "jeromq - java pojo zeromq". zeromq-dev mailing list. Archived from the original on 31 July 2013. Retrieved 23 May 2013.
- ^ "NetMQ". GitHub. Retrieved 23 May 2013.
- ^ "zmq.rs". GitHub. Retrieved 24 Oct 2020.
- ^ "Securing ZeroMQ: draft ZMTP v3.0 Protocol". Hintjens.com. Retrieved 23 May 2013.
- ^ curvezmq.org
- ^ "NNG: Nanomsg-NG". nanomsg.org. Retrieved 4 Aug 2023.
- ^ "Collective Code Construction Contract (C4.1)". ZeroMQ RFCs. Retrieved 23 May 2013.
External links
- Official website
- The ØMQ community on GitHub
- Martin Sustrik, Martin Lucina (January 20, 2010). 0MQ: A new approach to messaging – LWN.net
- ZeroMQ is the Answer (a talk at PHP UK conference 2012)
- ZeroMQ an introduction Archived 2010-07-08 at the Wayback Machine
- Why ZeroMQ? (introductory video)
- ZeroMQ: Modern & Fast Networking Stack (overview with Ruby examples)
- ØMQ: The Theoretical Foundation Archived 2020-06-30 at the Wayback Machine