Browsing All Posts filed under »Technologies«

In-Stream Big Data Processing

August 20, 2013

25

The shortcomings and drawbacks of batch-oriented data processing were widely recognized by the Big Data community quite a long time ago. It became clear that real-time query processing and in-stream processing is the immediate need in many practical applications. In recent years, this idea got a lot of traction and a whole bunch of solutions […]

Speeding Up Hadoop Builds Using Distributed Unit Tests

August 14, 2012

2

We recently worked with one of the Hadoop vendors on the continuous integration system for Hadoop core and other Hadoop-related projects like Pig, Hive, HBase. One of the challenges we faced was very slow automatic tests — full unit/integration test suite takes more than 2 hours for Hadoop core and more than 9 hours for […]

Fast Intersection of Sorted Lists Using SSE Instructions

June 5, 2012

17

Intersection of sorted lists is a cornerstone operation in many applications including search engines and databases because indexes are often implemented using different types of sorted structures. At GridDynamics, we recently worked on a custom database for realtime web analytics where fast intersection of very large lists of IDs was a must for good performance. From a functional […]

Hierarchical Navigation and Faceted Search on Top of Oracle Coherence

April 2, 2012

18

Some time ago I participated in design of a backend for one large online retailer company. From the business logic point of view, this was a pretty typical eCommerce service for hierarchical and faceted navigation, although not without peculiarities, but high performance requirements led us to the quite advanced architecture and technical design. In particular, we […]

Tricks with Direct Memory Access in Java

February 2, 2012

9

Java was initially designed as a safe, managed environment. Nevertheless, Java HotSpot VM contains a “backdoor” that provides a number of low-level operations to manipulate memory and threads directly. This backdoor – sun.misc.Unsafe – is widely used by JDK itself in the packages like java.nio or java.util.concurrent. It is hard to imagine a Java developer who uses this backdoor in […]

OSGi 4.2 Core Specification Overview

January 1, 2012

1

The presentation below contains a detailed description of major OSGi 4.2 features. This deck of slides covers the following topics: OSGi Technology Overview Module Layer Life Cycle Layer Service Layer Standard Service and Tools offered by OSGi

Follow

Get every new post delivered to your Inbox.

Join 1,624 other followers