Browsing All Posts filed under »Technologies«

In-Stream Big Data Processing

August 20, 2013


The shortcomings and drawbacks of batch-oriented data processing were widely recognized by the Big Data community quite a long time ago. It became clear that real-time query processing and in-stream processing is the immediate need in many practical applications. In recent years, this idea got a lot of traction and a whole bunch of solutions […]

Speeding Up Hadoop Builds Using Distributed Unit Tests

August 14, 2012


We recently worked with one of the Hadoop vendors on the continuous integration system for Hadoop core and other Hadoop-related projects like Pig, Hive, HBase. One of the challenges we faced was very slow automatic tests — full unit/integration test suite takes more than 2 hours for Hadoop core and more than 9 hours for […]

Fast Intersection of Sorted Lists Using SSE Instructions

June 5, 2012


Intersection of sorted lists is a cornerstone operation in many applications including search engines and databases because indexes are often implemented using different types of sorted structures. At GridDynamics, we recently worked on a custom database for realtime web analytics where fast intersection of very large lists of IDs was a must for good performance. From a functional […]

Hierarchical Navigation and Faceted Search on Top of Oracle Coherence

April 2, 2012


Some time ago I participated in design of a backend for one large online retailer company. From the business logic point of view, this was a pretty typical eCommerce service for hierarchical and faceted navigation, although not without peculiarities, but high performance requirements led us to the quite advanced architecture and technical design. In particular, we […]

Tricks with Direct Memory Access in Java

February 2, 2012


Java was initially designed as a safe, managed environment. Nevertheless, Java HotSpot VM contains a “backdoor” that provides a number of low-level operations to manipulate memory and threads directly. This backdoor – sun.misc.Unsafe – is widely used by JDK itself in the packages like java.nio or java.util.concurrent. It is hard to imagine a Java developer who uses this backdoor in […]

OSGi 4.2 Core Specification Overview

January 1, 2012


The presentation below contains a detailed description of major OSGi 4.2 features. This deck of slides covers the following topics: OSGi Technology Overview Module Layer Life Cycle Layer Service Layer Standard Service and Tools offered by OSGi


Get every new post delivered to your Inbox.

Join 1,699 other followers