Data Systems Artisan

One of the strengths of SciDB over other database management systems is its extensibility.1 SciDB allows the user to add new data types, functions, and operators. In this multi-part post, we discuss various aspects of extending SciDB. In this post we look at the available documentation and how to setup... [Read More]

In part 1 and part 2 of this multi-part post, we looked a how to load data from multiple files while capturing information present in the file name. In this post, we look at how to load data files organized as tables with a possibly large number of columns and... [Read More]

SciDB has extensive documentation but there is no official tutorial or getting started guide. In this post, we go over some of the tutorials and getting started materials available online. Please note that some of the materials listed here are more than two years old and specific functions or commands... [Read More]

To define a SciDB array we need to specify its dimensions. For each dimension, we need to specify its name, low value, high value, chunk length and chunk overlap (see documentation). The chunk parameters are somehow internal to SciDB and affect its performance. In this post, we look at a... [Read More]

Docker containers simplify the development and deployment of software through isolation. Containers are especially useful when the targeted software has a complicated installation procedure. This is the case for SciDB. SciDB needs to be compiled from source and requires a multitude of libraries and development tools to be installed. Moreover,... [Read More]