Beruflich Dokumente
Kultur Dokumente
.
[CloudKit, Perservere,Jackrabbit]
ThruDB
(please help provide more facts!) Uses Apache Thrift to integrate multiple backe
nd databases as BerkeleyDB, Disk, MySQL, S3.
iBoxDB
Transactional embedded database, it can embed into mobile, desktop and web appli
cations, supports on-disk and in-memory storages. API: Java,C# (Android, Mono, X
amarin, Unity3D). Query Method: SQL-like and KeyValue. Written In: Java, C#. Rep
lication: MasterSlave, MasterMaster.
BergDB
API: Java/.NET. Written in: Java. Replication: Master/Slave. License: AGLP. Hist
orical queries. ACID. Schemaless. Concurrency: STM and persistent data structure
. Append-only storage. Encrypted storage. Flexible durability control. Secondary
& composite indexes. Transparently serializes Java/.NET objects.
IBM Cloudant
Cloud based, open-source, zero-config. Based on CouchDB and BigCouch.
Key Value / Tuple Store
DynamoDB
Automatic ultra scalable NoSQL DB based on fast SSDs. Multiple Availability Zone
s. Elastic MapReduce Integration. Backup to S3 and much more...
Azure Table Storage
Collections of free form entities (row key, partition key, timestamp). Blob and
Queue Storage available, 3 times redundant. Accessible via REST or ATOM.
Riak
API: JSON, Protocol: REST, Query Method: MapReduce term matching , Scaling: Mult
iple Masters; Written in: Erlang, Concurrency: eventually consistent (stronger t
hen MVCC via Vector Clocks)
Redis
API: Tons of languages, Written in: C, Concurrency: in memory and saves asynchro
nous disk after a defined time. Append only mode available. Different kinds of f
sync policies. Replication: Master / Slave, Misc: also lists, sets, sorted sets,
hashes, queues. Cheat-Sheet: , great slides Admin UI From the Ground up
Aerospike
Fast and web-scale database. RAM or SSD. Predictable performance; achieves 2.5 M
TPS (reads and writes), 99% under 1 ms. Tunable consistency. Replicated, zero c
onfiguration, zero downtime, auto-clustering, rolling upgrades, Cross Datacenter
Replication (XDR). Written in: C. APIs: C, C#, Erlang, Go, Java, Libevent, Node
, Perl, PHP, Python, Ruby. Links: Community, Development, Slides, 2.5M TPS on 1
node at Intel, 1M TPS on AmazonWS, 1M TPS w/ SSDs on 1 Server, Combating Memory
Fragmentation
LevelDB
Fast & Batch updates. DB from Google. Written in C++. Blog , hot Benchmark , Artic
le (in German). Java access.
RocksDB
API: C++. Written in C++. Facebook`s improvements to Google`s LevelDB to speed t
hroughput for datasets larger than RAM. Embedded solution.
Berkeley DB
API: Many languages, Written in: C, Replication: Master / Slave, Concurrency: MV
CC, License: Sleepycat, Berkeley DB Java Edition: API: Java, Written in: Java, R
eplication: Master / Slave, Concurrency: serializable transaction isolation, Lic
ense: Sleepycat
Oracle NOSQL Database
Oracle NoSQL Database is a distributed key-value database. It is designed to pro
vide highly reliable, scalable and available data storage across a configurable
set of systems that function as storage nodes. NoSQL and the Enterprise Data is
stored as key-value pairs, which are written to particular storage node(s), base
d on the hashed value of the primary key. Storage nodes are replicated to ensure
high availability, rapid failover in the event of a node failure and optimal lo
ad balancing of queries. API: Java/C.
GenieDB
Immediate consistency sharded KV store with an eventually consistent AP store br
inging eventual consistency issues down to the theoretical minimum. It features
efficient record coalescing. GenieDB speaks SQL and co-exists / do intertable jo
ins with SQL RDBMs.
BangDB
API: Get,Put,Delete, Protocol: Native, HTTP, Flavor: Embedded, Network, Elastic
Cache, Replication: P2P based Network Overlay, Written in: C++, Concurrency: ?,
Misc: robust, crash proof, Elastic, throw machines to scale linearly, Btree/Ehas
h
Chordless
API: Java & simple RPC to vals, Protocol: internal, Query Method: M/R inside val
ue objects, Scaling: every node is master for its slice of namespace, Written in
: Java, Concurrency: serializable transaction isolation,
Scalaris
(please help provide more facts!) Written in: Erlang, Replication: Strong consis
tency over replicas, Concurrency: non blocking Paxos.
Tokyo Cabinet / Tyrant
Links: nice talk , slides , Misc: Kyoto Cabinet
Scalien
API / Protocol: http (text, html, JSON), C, C++, Python, Java, Ruby, PHP,Perl. C
oncurrency: Paxos.
Voldemort
Open-Source implementation of Amazons Dynamo Key-Value Store.
Dynomite
Open-Source implementation of Amazons Dynamo Key-Value Store. written in Erlang.
With "data partitioning, versioning, and read repair, and user-provided storage
engines provide persistence and query processing".
KAI
Open Source Amazon Dnamo implementation, Misc: slides
MemcacheDB
API: Memcache protocol (get, set, add, replace, etc.), Written in: C, Data Model
: Blob, Misc: Is Memcached writing to BerkleyDB.
Faircom C-Tree
API: C, C++, C#, Java, PHP, Perl, Written in: C,C++. Misc: Transaction logging.
Client/server. Embedded. SQL wrapper (not core). Been around since 1979.
LSM
Key-Value database that was written as part of SQLite4, They claim it is faster
then LevelDB. Instead of supporting custom comparators, they have a recommended
data encoding for keys that allows various data types to be sorted.
KitaroDB
: A fast, efficient on-disk data store for Windows Phone 8, Windows RT, Win32 (x
86 & x64) and .NET. Provides for key-value and multiple segmented key access. AP
Is for C#, VB, C++, C and HTML5/JavaScript. Written in pure C for high performan
ce and low footprint. Supports async and synchronous operations with 2GB max rec
ord size.
HamsterDB
: (embedded solution) ACID Compliance, Lock Free Architecture (transactions fail
on conflict rather than block), Transaction logging & fail recovery (redo logs)
can be used as a non-persisted cache, B+ Trees supported [So
, In Memory support
urce: Tony Bain ]
STSdb
API: C#, Written in C#, embedded solution, generic XTable<TKey,TRecord> implemen
tation, ACID transactions, snapshots, table versions, shared records, vertical d
ata compression, custom compression, composite & custom primary keys, available
backend file system layer, works over multiple volumes, petabyte scalability, LI
NQ.
Tarantool/Box
API: C, Perl, PHP, Python, Java and Ruby. Written in: Objective C ,Protocol: asy
nchronous binary, memcached, text (Lua console). Data model: collections of dime
che JSR 107 & .NET. Query SQL & DB Synchronization. Misc: Linear Scalability, Hi
gh Availability, WAN Replication, GUI based Administration & Monitoring Tools, D
istributed Messaging, MapReduce, Entry Processor and Aggregator
PickleDB
Redis inspired K/V store for Python object serialization.
Mnesia
(ErlangDB )
LightCloud
(based on Tokyo Tyrant)
Hibari
Hibari is a highly available, strongly consistent, durable, distributed key-valu
e data store
OpenLDAP
Key-value store, B+tree. Lightning fast reads+fast bulk loads. Memory-mapped fil
es for persistent storage with all the speed of an in-memory database. No tuning
conf required. Full ACID support. MVCC, readers run lockless. Tiny code, writte
n in C, compiles to under 32KB of x86-64 object code. Modeled after the Berkeley
DB API for easy migration from Berkeley-based code. Benchmarks against LevelDB,
Kyoto Cabinet, SQLite3, and BerkeleyDB are available, plus full paper and presen
tation slides.
Genomu
High availability, concurrency-oriented event-based K/V database with transactio
ns and causal consistency. Protocol: MsgPack, API: Erlang, Elixir, Node.js. Writ
ten in: Elixir, Github-Repo.
BinaryRage
BinaryRage is designed to be a lightweight ultra fast key/value store for .NET w
ith no dependencies. Tested with more than 200,000 complex objects written to di
sk per second on a crappy laptop :-) No configuration, no strange driver/connect
or, no server, no setup - simply reference the dll and start using it in less th
an a minute.
Elliptics
Github Page
DBreeze
Professional, open-source, NoSql (embedded Key/Value storage), transactional, AC
ID-compliant, multi-threaded, object database management system for .NET 3.0> MO
NO. Written in C#.
TreodeDB
API: Scala. Written in Scala. Replication: Replicas vote on writes and reads. Sh
arding: Hashes keys onto array of replica cohorts. Concurrency: Optimistic + Mul
tiversion Concurrency Control. Provides multirow atomic writes. Exposes optimist
ic concurrency through API to support HTTP Etags. Embedded solution.
BoltDB
Key/Value DB written in Go.
Serenety
Serenity database implements basic Redis commands and extends them with support
of Consistent Cursors, ACID transactions, Stored procedures, etc. The database i
s designed to store data bigger then available RAM.
[Scality , KaTree TomP2P , Kumofs , TreapDB , Wallet , NoSQLz , NMDB, luxio, actord
keyspace, flare, schema-free, RAMCloud]
[SubRecord, Mo8onDb, Dovetaildb]
Graph Databases
Neo4J
API: lots of langs, Protocol: Java embedded / REST, Query Method: SparQL, native
JavaAPI, JRuby, Replication: typical MySQL style master/slave, Written in: Java,
Concurrency: non-block reads, writes locks involved nodes/relationships until c
ommit, Misc: ACID possible, Links: Video , Blog
ArangoDB
(Doc Store & GraphDB & Key-Value. More details in Category Multimodel Databases)
Infinite Graph
(by Objectivity) API: Java, Protocol: Direct Language Binding, Query Method: Gra
ph Navigation API, Predicate Language Qualification, Written in: Java (Core C++)
, Data Model: Labeled Directed Multi Graph, Concurrency: Update locking on subgr
aphs, concurrent non-blocking ingest, Misc: Free for Qualified Startups.
Sparksee
(former DEX): API: Java, .NET, C++, Python, Objective-C, Blueprints Interface Pr
otocol: Embedded, Query Method: as above + Gremlin (via Blueprints), Written in:
C++, Data Model: Labeled Directed Attributed Multigraph, Concurrency: yes, Misc
: ACID possible, Free community edition up to 1 Mio objects, Links: Intro , Techn
ical Overview
TITAN
: API: Java, Blueprints, Gremlin, Python, Clojure Protocol: Thrift, RexPro(Binar
y), Rexster (HTTP/REST) Query Method: Gremlin, SPARQL Written In: Java Data Mode
l: labeled Property Graph, directed, multi-graph adjacency list Concurrency: ACI
D Tunable C Replication: Multi-Master License: Apache 2 Pluggable backends: Cass
andra, HBase, MapR M7 Tables, BDB, Persistit, Hazelcast Links: Titan User Group
InfoGrid
API: Java, http/REST, Protocol: as API + XPRISO, OpenID, RSS, Atom, JSON, Java e
mbedded, Query Method: Web user interface with html, RSS, Atom, JSON output, Jav
a native, Replication: peer-to-peer, Written in: Java, Concurrency: concurrent r
eads, write lock within one MeshBase, Misc: Presentation
HyperGraphDB
API: Java (and Java Langs), Written in:Java, Query Method: Java or P2P, Replicat
ion: P2P, Concurrency: STM, Misc: Open-Source, Especially for AI and Semantic We
b.
GraphBase
Sub-graph-based API, query language, tools & transactions. Embedded Java, remote
-proxy Java or REST. Distributed storage & processing. Read/write all Nodes. Per
missions & Constraints frameworks. Object storage, vertex-embedded agents. Suppo
rts multiple graph models. Written in Java
Trinity
API: C#, Protocol: C# Language Binding, Query Method: Graph Navigation API, Repl
ication: P2P with Master Node, Written in: C#, Concurrency: Yes (Transactional u
pdate in online query mode, Non-blocking read in Batch Mode) Misc: distributed i
n-memory storage, parallel graph computation platform (Microsoft Research Projec
t)
AllegroGraph
API: Java, Python, Ruby, C#, Perl, Clojure, Lisp Protocol: REST, Query Method: S
PARQL and Prolog, Libraries: Social Networking Analytics & GeoSpatial, Written i
n: Common Lisp, Links: Learning Center , Videos
BrightstarDB
A native, .NET, semantic web database with code first Entity Framework, LINQ and
OData support. API: C#, Protocol: SPARQL HTTP, C#, Query Method: LINQ, SPARQL,
Written in: C#
Bigdata
API: Java, Jini service discovery, Concurrency: very high (MVCC), Written in: Ja
va, Misc: GPL + commercial, Data: RDF data with inference, dynamic key-range sha
rding of indices, Misc: Blog (parallel database, high-availability architecture,
immortal database with historical views)
Meronymy
RDF enterprise database management system. It is cross-platform and can be used
with most programming languages. Main features: high performance, guarantee data
base transactions with ACID, secure with ACL's, SPARQL & SPARUL, ODBC & JDBC dri
vers, RDF & RDFS.
WhiteDB
WhiteDB is a fast lightweight graph/N-tuples shared memory database library writ
ten in C with focus on speed, portability and ease of use. Both for Linux and Wi
ndows, dual licenced with GPLv3 and a free nonrestrictive royalty-free commercia
l licence.
OpenLink Virtuoso
Hybrid DBMS covering the following models: Relational, Document, Graph
VertexDB
FlockDB
by twitter
weaver
scalable, fast, consistent
BrightstarDB
Execom IOG
Fallen 8
Github
[Java Universal Network / Graph Framework, OpenRDF / Sesame, Filament, OWLim, Ne
tworkX, iGraph, Jena]
List of SPARQL implementations can be found here
Multimodel Databases
ArangoDB
API: REST, Graph Blueprints, C#, D, Ruby, Python, Java, PHP, Go, Python, etc. Da
ta Model: Documents, Graphs and Key/Values. Protocol: HTTP using JSON. Query Met
hod: declarative query language (AQL), query by example. Replication: master-sla
ve (m-m to follow), Sharding: automatic and configurable Written in: C/C++/Javas
cript (V8 integrated), Concurrency: MVCC, tuneable Misc: ACID transactions, micr
oservices framework "Foxx" (Javascript), many indices as secondary, fulltext, ge
o, hash, Skip-list, capped collections
OrientDB
Languages: Java, Schema: Has features of an Object-Database, DocumentDB, GraphDB
or Key-Value DB, Written in: Java, Query Method: Native and SQL, Misc: really f
ast, lightweight, ACID with recovery.
Datomic
API: Many jvm languages, Protocol: Native + REST, Query Method: Datalog + custom
extensions, Scaling: elastic via underlying DB (in-mem, DynamoDB, Riak, CouchBa
se, Infinispan, more to come), Written in: Clojure, Concurrency: ACID MISC: smar
t caching, unlimited read scalability, full-text search, cardinality, bi-directi
onal refs 4 graph traversal, loves Clojure + Storm.
FoundationDB
Bought by Apple Inc. Not available any more.
FatDB
.NET solution with tight SQL Server integration. API: C# Protocol: Protobuf or R
aw Binary Query Method: LINQ Replication: All peer network, multiple consistency
strategies Written in: C#, .NET Concurrency: Variable, Many Strategies License:
Free Community Edition + Commercial Options Misc: Bi-Directional SQL Server syn
c, Integrated File Management System, Asynchronous Work Queue, Unified Routing,
Fault Tolerance, Hosting agnostic (in-house, AWS, Azure etc) Links: 1, 2 Free Do
wnload
AlchemyDB
GraphDB + RDBMS + KV Store + Document Store. Alchemy Database is a low-latency h
igh-TPS NewSQL RDBMS embedded in the NOSQL datastore redis. Extensive datastoreside-scripting is provided via deeply embedded Lua. Bought and integrated with A
erospike.
CortexDB
CortexDB is a dynamic schema-less multi-model data base providing nearly all adv
antages of up to now known NoSQL data base types (key-value store, document stor
e, graph DB, multi-value DB, column DB) with dynamic re-organization during cont
inuous operations, managing analytical and transaction data for agile software c
onfiguration,change requests on the fly, self service and low footprint.
WonderDB
API:JDBC,SQL; WonderDB is fully transactional, distributed NewSQL database imple
mented in java based on relational architectures. So you can get best of both wo
rlds, sql, joins and ease of use from SQL and distribution, replication and shar
ding from NoSQL movement. Tested performance is over 60K per node with Amazon m3
.xlarge VM.
The following section containts Soft NoSQL Systems
[Mostly NOT originated out of a Web 2.0 need but worth a look for great non rela
tional solutions]
Object Databases
Versant
API: Languages/Protocol: Java, C#, C++, Python. Schema: language class model (ea
sy changable). Modes: always consistent and eventually consistent Replication: s
ynchronous fault tolerant and peer to peer asynchronous. Concurrency: optimistic
and object based locks. Scaling: can add physical nodes on fly for scale out/in
and migrate objects between nodes without impact to application code. Misc: Map
Reduce via parallel SQL like query across logical database groupings.
db4o
API: Java, C#, .Net Langs, Protocol: language, Query Method: QBE (by Example), S
oda, Native Queries, LINQ (.NET), Replication: db4o2db4o & dRS to relationals, W
ritten in: Java, Cuncurrency: ACID serialized, Misc: embedded lib, Links: DZone
Refcard #53 , Book ,
Objectivity
API: Languages: Java, C#, C++, Python, Smalltalk, SQL access through ODBC. Schem
a: native language class model, direct support for references, interoperable acr
oss all language bindings. 64 bit unique object ID (OID) supports multi exa-byte
. Platforms: 32 and 64 bit Windows, Linux, Mac OSX, *Unix. Modes: always consist
ent (ACID). Concurrency: locks at cluster of objects (container) level. Scaling:
unique distributed architecture, dynamic addition/removal of clients & servers,
cloud environment ready. Replication: synchronous with quorum fault tolerant ac
ross peer to peer partitions.
GemStone/S
API: Java, C, C++, Smalltalk Schema: language class model Platforms: Linux, AIX,
Solaris, Mac OSX, Windows clients Modes: always consistent (ACID) Replication:
shared page cache per node, hot standby failover Concurrency: optimistic and obj
ect based locks Scaling: arbitrarily large number of nodes Misc: SQL via GemConn
ect
Starcounter
API: C# (.NET languages), Schema: Native language class model, Query method: SQL
, Concurrency: Fully ACID compliant, Storage: In-memory with transactions secure
d on disk, Reliability: Full checkpoint recovery, Misc: VMDBMS - Integrating the
DBMS with the virtual machine for maximal performance and ease of use.
Perst
API: Java,Java ME,C#,Mono. Query method: OO via Perst collections, QBE, Native Q
ueries, LINQ, native full-text search, JSQL Replication: Async+sync (master-slav
e) Written in: Java, C#. Caching: Object cache (LRU, weak, strong), page pool, i
n-memory database Concurrency: Pessimistic+optimistic (MVCC) + async or sync (AC
ID) Index types: Many tree models + Time Series. Misc: Embedded lib., encryption
, automatic recovery, native full text search, on-line or off-line backup.
VelocityDB
Written in100% pure C#, Concurrency: ACID/transactional, pessimistic/optimistic
locking, Misc: compact data, B-tree indexes, LINQ queries, 64bit object identifi
ers (Oid) supporting multi millions of databases and high performance. Deploy wi
th a single DLL of around 400KB.
HSS Database
Written in: 100% C#, The HSS DB v3.0 (HighSpeed-Solutions Database), is a client
based, zero-configuration, auto schema evolution, acid/transactional, LINQ Quer
y, DBMS for Microsoft .NET 4/4.5, Windows 8 (Windows Runtime), Windows Phone 7.5
/8, Silverlight 5, MonoTouch for iPhone and Mono for Android
ZODB
API: Python, Protocol: Internal, ZEO, Query Method: Direct object access, zope.c
atalog, gocept.objectquery, Replication: ZEO, ZEORAID, RelStorage Written in: Py
thon, C Concurrency: MVCC, License: Zope Public License (OSI approved) Misc: Use
ike, Concurrency: ACID, Replication: differential sync, Misc: DVCS based on obje
ct graph diffs, selective undo, refs accross versioned docs, tagging, temporal i
ndexing, integrity checking.
[ StupidDB , KiokuDB (Perl solution), Durus ]
Grid & Cloud Database Solutions
Oracle Coherence
Oracle Coherence offers distributed, replicated, multi-datacenter, tiered (off-h
eap/SSD) and near (client) caching. It provides distributed processing, querying
, eventing, and map/reduce, session management, and prorogation of database upda
tes to caches. Operational support provided by a Grid Archive deployment model.
GigaSpaces
Popular SpaceBased Grid Solution.
GemFire
GemFire offers in-memory globally distributed data management with dynamic scala
bility, very high performance and granular control supporting the most demanding
applications. Well integrated with the Spring Framework, developers can quickly
and easily provide sophisticated data management for applications. With simple
horizontal scale-out, data latency caused by network roundtrips and disk I/O can
be avoided even as applications grow.
Infinispan
scalable, highly available data grid platform, open source, written in Java.
Queplix
NO
NOSQL Data Integration Environment, can integrate relational, object, BigData
SQL easily and without any SQL.
Hazelcast
Hazelcast is a in-memory data grid that offers distributed data in Java with dyn
amic scalability under the Apache 2 open source license. It provides distributed
data structures in Java in a single Jar file including hashmaps, queues, locks,
topics and an execution service that allows you to simply program these data st
ructures as pure java objects, while benefitting from symmetric multiprocessing
and cross-cluster shared elastic memory of very high ingest data streams and ver
y high transactional loads.
Crate Data
A