LMDBMemoryManager

java.lang.Object
- edu.iu.dsc.tws.data.memory.AbstractMemoryManager
- - edu.iu.dsc.tws.data.memory.lmdb.LMDBMemoryManager

All Implemented Interfaces:

MemoryManager
```
public class LMDBMemoryManager
extends AbstractMemoryManager
```
Memory Manger implementaion for LMDB Java https://github.com/lmdbjava/lmdbjava

Field Summary

Fields
Modifier and Type	Field and Description
`protected java.util.concurrent.locks.Lock`	`lock`
`protected static java.lang.Boolean`	`needsCommitReader`
`protected static java.lang.Boolean`	`needsCommitWriter`

Fields inherited from class edu.iu.dsc.tws.data.memory.AbstractMemoryManager
operationMap

Constructor Summary

Constructors
Constructor and Description

LMDBMemoryManager(Path dataPath)

Constructors
Constructor and Description
`LMDBMemoryManager(Path dataPath)`

Method Summary

All Methods Instance Methods Concrete Methods
Modifier and Type	Method and Description
`OperationMemoryManager`	`addOperation(int opID, DataMessageType messageType)` At this level the method does not return an OperationMemoryManager since the implementaion does not handle OperationMemoryManager's
`OperationMemoryManager`	`addOperation(int opID, DataMessageType messageType, DataMessageType keyType)`
`boolean`	`append(int opID, java.nio.ByteBuffer key, java.nio.ByteBuffer value)` Appends the given byte buffer to the current value in the store.
`boolean`	`append(int opID, java.lang.String key, java.nio.ByteBuffer value)`
`boolean`	`close(int opID, java.nio.ByteBuffer key)` flush and close the given key.
`boolean`	`close(int opID, java.lang.String key)`
`boolean`	`containsKey(int opID, java.nio.ByteBuffer key)` checks if the given key is in the memory manager
`boolean`	`containsKey(int opID, java.lang.String key)` checks if the given key is in the memory manager
`boolean`	`delete(int opID, java.nio.ByteBuffer key)` delete the given key from the store
`boolean`	`delete(int opID, java.lang.String key)` delete the given key from the store
`boolean`	`flush(int opID)`
`boolean`	`flush(int opID, java.nio.ByteBuffer key)` Flush all the data into the store.
`boolean`	`flush(int opID, java.lang.String key)`
`java.nio.ByteBuffer`	`get(int opID, java.nio.ByteBuffer key)` Get the corresponding value as ByteBuffer for the given key from the store
`java.nio.ByteBuffer`	`get(int opID, java.lang.String key)` Get the corresponding value as ByteBuffer for the given key from the store
`java.nio.ByteBuffer`	`getAll(java.nio.ByteBuffer key)`
`<any>`	`getDb()`
`<any>`	`getEnv()`
`java.util.Iterator<java.lang.Object>`	`getIterator(int opID, DataMessageType keyType, DataMessageType valueType, KryoSerializer deSerializer, java.nio.ByteOrder order)` Returns an iterator that contains all the byte buffers for the given operation
`java.util.Iterator<java.lang.Object>`	`getIterator(int opID, DataMessageType valueType, KryoSerializer deSerializer, java.nio.ByteOrder order)` Returns an iterator that contains all the byte buffers for the given operation This method assumes that the keys are int's and that the do not need to be returned
`Path`	`getLmdbDataPath()`
`boolean`	`init()` Initializes the Memory manager
`boolean`	`put(int opID, byte[] key, byte[] value)` Insert key value pair into the
`boolean`	`put(int opID, java.nio.ByteBuffer key, java.nio.ByteBuffer value)` Insert key value pair into the
`boolean`	`put(int opID, java.util.List<java.nio.ByteBuffer> keys, java.util.List<java.nio.ByteBuffer> values)` Insert bulk key value pair into the
`boolean`	`put(int opID, java.lang.String key, java.nio.ByteBuffer value)` Stores the give key value pair in the memory manager
`boolean`	`removeOperation(int opID)` Remove an operation from the memory manager.
`void`	`setDb(<any> db)`
`void`	`setEnv(<any> env)`
`void`	`setLmdbDataPath(Path lmdbDataPath)`

Methods inherited from class edu.iu.dsc.tws.data.memory.AbstractMemoryManager
getDeserialized, getDeserialized, getDeserialized

Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

lock

protected java.util.concurrent.locks.Lock lock

needsCommitWriter

protected static java.lang.Boolean needsCommitWriter

needsCommitReader

protected static java.lang.Boolean needsCommitReader

Constructor Detail

LMDBMemoryManager

public LMDBMemoryManager(Path dataPath)

Method Detail

init
```
public boolean init()
```
Description copied from interface: MemoryManager

Initializes the Memory manager

get
```
public java.nio.ByteBuffer get(int opID,
                               java.nio.ByteBuffer key)
```
Description copied from interface: MemoryManager

Get the corresponding value as ByteBuffer for the given key from the store

get
```
public java.nio.ByteBuffer get(int opID,
                               java.lang.String key)
```
Description copied from interface: MemoryManager

Get the corresponding value as ByteBuffer for the given key from the store

getAll

public java.nio.ByteBuffer getAll(java.nio.ByteBuffer key)

containsKey
```
public boolean containsKey(int opID,
                           java.nio.ByteBuffer key)
```
Description copied from interface: MemoryManager

checks if the given key is in the memory manager

key - key to be checked

Returns:

true if the key is present, false otherwise

containsKey
```
public boolean containsKey(int opID,
                           java.lang.String key)
```
Description copied from interface: MemoryManager

checks if the given key is in the memory manager

key - key to be checked

Returns:

true if the key is present, false otherwise

append
```
public boolean append(int opID,
                      java.nio.ByteBuffer key,
                      java.nio.ByteBuffer value)
```
Description copied from interface: MemoryManager

Appends the given byte buffer to the current value in the store. If the store does not contain the given key append works as a put operation

Parameters:

opID - id value of the operation

key - key to append to

value - value to be appended

Returns:

true if append was performed, false otherwise

append

public boolean append(int opID,
                      java.lang.String key,
                      java.nio.ByteBuffer value)

put
```
public boolean put(int opID,
                   java.nio.ByteBuffer key,
                   java.nio.ByteBuffer value)
```
Insert key value pair into the

Parameters:

key - the key, must be unver 511 bytes because of limits in LMDB implementaion

value - the value to be added

Returns:

true if value was added, false otherwise

put
```
public boolean put(int opID,
                   byte[] key,
                   byte[] value)
```
Insert key value pair into the

Parameters:

key - the key, must be unver 511 bytes because of limits in LMDB implementaion

value - the value to be added

Returns:

true if value was added, false otherwise

put
```
public boolean put(int opID,
                   java.util.List<java.nio.ByteBuffer> keys,
                   java.util.List<java.nio.ByteBuffer> values)
```
Insert bulk key value pair into the

Parameters:

keys - the keys, must be unver 511 bytes because of limits in LMDB implementaion

values - the values to be added

Returns:

true if value was added, false otherwise

put

public boolean put(int opID,
                   java.lang.String key,
                   java.nio.ByteBuffer value)

Description copied from interface: MemoryManager

Stores the give key value pair in the memory manager

delete
```
public boolean delete(int opID,
                      java.nio.ByteBuffer key)
```
Description copied from interface: MemoryManager

delete the given key from the store

delete
```
public boolean delete(int opID,
                      java.lang.String key)
```
Description copied from interface: MemoryManager

delete the given key from the store

addOperation
```
public OperationMemoryManager addOperation(int opID,
                                           DataMessageType messageType)
```
At this level the method does not return an OperationMemoryManager since the implementaion does not handle OperationMemoryManager's

Returns:

returns the memory manager or null (Null is returned at the base layer)

addOperation

public OperationMemoryManager addOperation(int opID,
                                           DataMessageType messageType,
                                           DataMessageType keyType)

removeOperation
```
public boolean removeOperation(int opID)
```
Description copied from interface: MemoryManager

Remove an operation from the memory manager. This will result in loss of all the data related to the operation in the memory manager

Parameters:

opID - operation id to be removed

Returns:

true if the operation was removed, false otherwise

flush
```
public boolean flush(int opID,
                     java.nio.ByteBuffer key)
```
Description copied from interface: MemoryManager

Flush all the data into the store. This method is needed only if buffering is done at the Memory Manager

Parameters:

opID - id of the operation

key - key to be flushed

flush
```
public boolean flush(int opID)
```

flush

public boolean flush(int opID,
                     java.lang.String key)

close
```
public boolean close(int opID,
                     java.nio.ByteBuffer key)
```
Description copied from interface: MemoryManager

flush and close the given key. After close is performed the key data will only be available in the store. This method is needed only if buffering is done at the Memory Manager

Parameters:

opID - id of the operation

key - key to be closed

close

public boolean close(int opID,
                     java.lang.String key)

getIterator

public java.util.Iterator<java.lang.Object> getIterator(int opID,
                                                        DataMessageType keyType,
                                                        DataMessageType valueType,
                                                        KryoSerializer deSerializer,
                                                        java.nio.ByteOrder order)

Returns an iterator that contains all the byte buffers for the given operation

getIterator

public java.util.Iterator<java.lang.Object> getIterator(int opID,
                                                        DataMessageType valueType,
                                                        KryoSerializer deSerializer,
                                                        java.nio.ByteOrder order)

Returns an iterator that contains all the byte buffers for the given operation This method assumes that the keys are int's and that the do not need to be returned

getLmdbDataPath
```
public Path getLmdbDataPath()
```

setLmdbDataPath

public void setLmdbDataPath(Path lmdbDataPath)

getEnv
```
public <any> getEnv()
```

setEnv
```
public void setEnv(<any> env)
```

getDb
```
public <any> getDb()
```

setDb
```
public void setDb(<any> db)
```

Class LMDBMemoryManager

Field Summary

Fields inherited from class edu.iu.dsc.tws.data.memory.AbstractMemoryManager

Constructor Summary

Method Summary

Methods inherited from class edu.iu.dsc.tws.data.memory.AbstractMemoryManager

Methods inherited from class java.lang.Object

Field Detail

lock

needsCommitWriter

needsCommitReader

Constructor Detail

LMDBMemoryManager

Method Detail

init

get

get

getAll

containsKey

containsKey

append

append

put

put

put

put

delete

delete

addOperation

addOperation

removeOperation

flush

flush

flush

close

close

getIterator

getIterator

getLmdbDataPath

setLmdbDataPath

getEnv

setEnv

getDb

setDb