MicroStream Enterprise Edition Open-Beta is Available

MicroStream Enterprise Edition is a powerful extension to EclipseStore. The main features are indexing and the GigaMap providing fully automated lazy loading.

Indexing

Indexing is a data structure technique to optimize search performance in EclipseStore, comparable to indexing concepts in database systems. It creates a sorted list of values and their corresponding objects, allowing EclipseStore to quickly locate specific objects without scanning the entire collection. Think of it like an index in a book: it points to the specific page where a particular topic is discussed, saving you the time of flipping through every page.

Off-Heap Bitmap Indexing: A Speed Demon

Bitmap indexes are a specialized data structure that uses bitmaps to represent the presence or absence of a specific value within a collection. Each bit in the bitmap corresponds to an element in the collection. If the value is present in the element, the bit is set to 1; otherwise, it’s 0. The MicroStream bitmap index is managed off-heap.

Why Off-Heap Management Makes it Lightning-Fast

• Direct Memory Access: By managing the bitmap index off-heap, the index data is stored directly in system memory, bypassing the Java heap. This eliminates the overhead of garbage collection, a major performance bottleneck in traditional Java applications.
• Reduced GC Pressure: Off-heap storage reduces the memory footprint of the Java heap, leading to fewer garbage collection cycles and improved overall performance.
• Optimized Read/Write Operations: Direct memory access allows for faster read and write operations on the bitmap index, further accelerating search queries.

GigaMap

GigaMap is a specialized collection designed to optimize performance and memory usage in EclipseStore. It leverages off-heap bitmap indexing to enable lightning-fast searches and lazy loading of objects, without the need for manual reference management.

• Off-Heap Bitmap Index: GigaMap uses the off-heap bitmap index concept to provide rapid lookup of objects based on specific criteria.
• Automated Lazy-Loading: When an object is accessed for the first time, GigaMap efficiently fetches and loads it from the underlying storage, minimizing memory footprint and improving startup time.
• Transparent Integration: GigaMap seamlessly integrates with EclipseStore’s data model, making it easy to use and maintain.
• Scalability: GigaMap can handle massive datasets, thanks to its efficient indexing and lazy-loading mechanisms.

Added Value of MicroStream Enterprise Edition

With the new GigaMap and the underlying new indexing off-heap bitmap index concept, the MicroStream Enterprise Edition can achieve the following benefits:

By integrating indexing and GigaMap, EclipseStore becomes a powerful platform for handling big data – extremely large datasets. This combination offers the following benefits:

Performance Boost:

• Rapid Search and Retrieval: The efficient bitmap index enables lightning-fast searches, significantly reducing query response times, even for massive datasets.
• Optimized Memory Usage: GigaMap’s lazy-loading mechanism minimizes memory consumption by loading objects only when necessary, making it ideal for handling large datasets.
• Improved Scalability: Both technologies are designed to handle growing workloads and increasing data volumes, ensuring consistent performance.

Developer Productivity:

• Simplified Development: GigaMap’s automated lazy loading eliminates the need for manual reference management, streamlining development efforts.
• Enhanced Focus: Developers can concentrate on core application logic without worrying about low-level performance optimizations or managing large datasets.

Enhanced User Experience:

• Faster Response Times: Rapid search and retrieval capabilities lead to quicker application responses, improving user satisfaction.
• Smoother Interactions: Optimized memory usage and efficient object loading contribute to a more seamless user experience, even when dealing with complex and data-intensive applications.

In essence, the combination of indexing and GigaMap positions EclipseStore as a robust platform for big data applications, offering exceptional performance, scalability, and developer productivity.

License

MicroStream Enterprise Edition is a commercial extension built upon the open-source foundation of EclipseStore. While the core EclipseStore project remains open-source, MicroStream Enterprise Edition offers additional features and capabilities. Currently available as an open beta, the Enterprise Edition is free to use. However, final release will require an annual subscription fee per application.

Get Started

MicroStream Enterprise Edition final release will be available soon. To download the Open-Beta:

1. Create a free MicroStream SaaS Account.
2. Sign in and choose MicroStream Enterprise Edition.
3. Copy the dependencies into your project.
4. Check out the demos on GitHub.

Documentation

You will find the documentation for the MicroStream Enterprise Edition on GitHub:
microstream-one/enterprise-edition-beta: MicroStream Enterprise Edition Beta Program

What do you think about MicroStream Enterprise Edition?
Have you already tryed the new GigaMap?
What are you using EclipseStore for?
Are you missing certain features?

Click “View Comments” below and leave a comment.
Thank you!