I have been using SciDB since early 2016. I am impressed and pleasantly challenged with SciDB. Here I am writing about my experiences and I hope these posts will be useful to other folks. Your comments and feedback are greatly appreciated. — Rares Vernica

Keep an Eye on the Chunk Length

Don't Let the "slice" Operator Choke

To define a SciDB array we need to specify its dimensions. For each dimension, we need to specify its name, low value, high value, chunk length and chunk overlap (see documentation). The chunk parameters are somehow internal to SciDB and affect its performance. In this post, we look at a... [Read More]

Unleashing SciDB in a Docker Container

Building a Docker Image for SciDB

Docker containers simplify the development and deployment of software through isolation. Containers are especially useful when the targeted software has a complicated installation procedure. This is the case for SciDB. SciDB needs to be compiled from source and requires a multitude of libraries and development tools to be installed. Moreover,... [Read More]

The Power of Loading Data - Part 1

Multiple Files with Metadata

Loading data into a database is a very important operation. SciDB is no exception. Build-in SciDB is the vanilla load operator documented here. On top of that Paradigm4 provides an advanced loading operator as part of their accelerated_io_tools plugin. Similar to SciDB, this plugin is open-source but different from SciDB,... [Read More]

Getting Started with SciDB

Using SciDB Amazon Machine Image

The easiest way to get started with SciDB is using Amazon Web Services (AWS). There are multiple SciDB Amazon Machine Images (AMI) provided by Paradigm4 (the company behind SciDB). For each AMI, the type of Amazon Elastic Cloud Compute (EC2) instance recommended by Paradigm4 is pretty beefy. We recommend following... [Read More]