Queue Behavior and Usage in Cache

A Queue is an ordered data structure that uses the principle of First In First Out (FIFO) behavior. You can use Queues to maintain information being processed at runtime. For example, the application IDs of potential candidates for a company can be stored in a Queue. As the Queue is FIFO in nature, the first candidate to apply will be interviewed first, and so on.

NCache further enhances Queue data structure by providing NCache-specific features such as Groups, Tags, Expiration, Locking, Dependencies, and more. In this scenario, the company can specify a group against a Queue of people who applied for administrative jobs.

Behavior

A Queue can be of any primitive type or custom object.
A Queue of CacheItem and nested Queues are not yet supported.
Queues are named. Hence, you need to provide a unique cache key for a Queue.
Null is not a supported value type.
Duplicate values are supported.

Prerequisites

To learn about the standard prerequisites required to work with all NCache client-side features, please refer to the given page on Client-Side API Prerequisites.
For API details, refer to: ICache, IDistributedQueue, IDataTypeManager, Contains, CopyTo, ToArray, Peek, GetQueue, Dequeue, Enqueue, EnqueueBulk, DequeueBulk, CreateQueue, RegisterNotification, DataTypeDataNotificationCallback, EventType, DataTypeEventDataFilter, Lock, Unlock.

Create Queue and Add Data

The following code sample shows how a Queue of Candidate type can be created in the cache against the cache key CandidateQueue and how items are added to the Queue.

Tip

You can also configure searchable attributes such as Groups/Tags/Named Tags and invalidation attributes such as Expiration/Eviction/Dependency while creating a data structure.

// Precondition: Cache must be connected

// Specify unique cache key for Queue
string key = "CandidateQueue";

// Create Queue of Candidate type
IDistributedQueue<Candidate> queue = cache.DataTypeManager.CreateQueue<Candidate>(key);
Candidate[] candidates = FetchCandidates();
foreach(var candidate in candidates)
{
    // Add candidates to Queue
    queue.Enqueue(candidate);
}

// Precondition: Cache must be connected

// Specify unique cache key for Queue
String key = "CandidateQueue";

// Create Queue of Candidate type
DistributedQueue<Candidate> queue = cache.getDataStructuresManager().createQueue(key, Candidate.class);
Candidate[] candidates = fetchCandidates();
for (var candidate : candidates) {
    // Add candidates to Queue
    queue.add(candidate);
}

# Precondition: Cache must be connected
# Specify unique cache key for Queue
key = "CandidateQueue"

# Create Queue
manager = cache.get_data_structures_manager()
queue = manager.create_queue(key, Candidate)

candidates = fetch_candidates()

for candidate in candidates:
    # Add candidates to Queue
    queue.add(candidate)

# Check if a candidate exists against given ID
candidate = get_candidate_by_id(1002)

if queue.contains(candidate):
    # Candidate exists with this ID
    print("Candidate found")

// This is an async method
// Precondition: Cache must be connected

// Specify unique cache key for Queue
var key = "CandidateQueue";

// Create Queue
var manager = await this.cache.getDataStructuresManager();
var queue = await manager.createQueue(key, ncache.JsonDataType.Object);
var candidates = this.fetchCandidates();
for (var candidate in candidates) {
// Add candidates to Queue
queue.add(candidate);
}

Create Queue and Add Data in Bulk

If you want to add multiple items in a single call, you can use the EnqueueBulk method. The following code sample shows how a Queue of Candidate type can be created in the cache against the cache key CandidateQueue and how multiple items can be added to the Queue in bulk.

Note

The EnqueueBulk method ensures that items are added in the same order as they appear in the provided list.

.NET

// Specify unique cache key for Queue
string key = "CandidateQueue";

// Create Queue of Candidate type
IDistributedQueue<Candidate> queue = cache.DataTypeManager.CreateQueue<Candidate>(key);
Candidate[] candidates = FetchCandidates();

// Add a list of candidates into the Queue
queue.EnqueueBulk(candidates);

If any error occurs while adding an item during the EnqueueBulk operation, the entire process is rolled back. The user will either have all the items enqueued, or an exception will be thrown, with no items added.

Fetch and Perform Other Methods on the Queue

The following code sample fetches a Queue from the cache using the GetQueue method and then checks whether an item exists in the Queue or not using the Contains method. How to get an item from the beginning of the Queue without removing it using the Peek method. To copy the entire source Queue to the target array using the CopyTo method, and to copy this Queue into a one-dimensional array using the ToArray method.

// Queue with this key already exists in cache
string key = "CandidateQueue";

// Get Queue and show items of Queue
IDistributedQueue<Candidate> retrievedQueue = cache.DataTypeManager.GetQueue<Candidate>(key);

// Get any candidate ID
Candidate candidate = GetCandidateByID(1002);

// Check whether Queue contains the particular candidate or not
if(retrievedQueue.Contains(candidate))
{
    // Candidate exists with this ID
}
// List of candidates for the Queue to be copied into
Candidate[] candidates = new Candidate[retrievedQueue.Count];

// Copy the Queue to another array
retrievedQueue.CopyTo(candidates, 0);

// Copy Queue to one-dimensional array
candidates = retrievedQueue.ToArray();

// Get an item at beginning from Queue without removing
Candidate firstCandidate = retrievedQueue.Peek();

// Queue with this key already exists in cache
String key = "CandidateQueue";

// Get Queue and show items of Queue
DistributedQueue<Candidate> retrievedQueue = cache.getDataStructuresManager().getQueue(key, Candidate.class);

// Get any candidate ID
Candidate candidate = getCandidateByID(1002);

// Check whether Queue contains the a particular candidate or not
if(retrievedQueue.contains(candidate))
{
    // Candidate exists with this ID
}

// List of candidates for the Queue to be copied into
Candidate[] candidates = new Candidate[retrievedQueue.size()];

// Copy the Queue to another array
retrievedQueue.copyTo(candidates, 0);

// Copy Queue to one-dimensional array
candidates = retrievedQueue.toArray();

// Get an item at beginning from Queue without removing
Candidate firstCandidate = retrievedQueue.peek();

# Queue with this key already exists in cache
key = "CandidateQueue"

# Get Queue and show items of Queue
manager = cache.get_data_structures_manager()
retrieved_queue = manager.get_queue(key, Candidate)

if retrieved_queue is not None:
    for item in retrieved_queue.get_iterator():
        # Perform operations
        print(item)
else:
    # Queue does not exist
    print("Queue not found")

// This is an async method
// Queue with this key already exists in cache
var key = "CandidateQueue";

// Get Queue and show items of Queue
var manager = await this.cache.getDataStructuresManager();
var retrievedQueue = await manager.getQueue(key, ncache.JsonDataType.Object);

// Get any candidate ID
var candidate = this.getCandidateByID(1002);

// Check whether Queue contains the a particular candidate or not
if(retrievedQueue.contains(candidate))
{
// Candidate exists with this ID
}
// List of candidates for the Queue to be copied into
var candidates = new Candidate[retrievedQueue.length];

// Copy the Queue to another array
retrievedQueue.copyTo(candidates, 0);

// Copy Queue to one-dimensional array
var candidates = retrievedQueue.toArray();

// Get an item at beginning from Queue without removing
var firstCandidate = retrievedQueue.peek();

Remove Items from the Queue

Items can be removed from the Queue in a FIFO manner. The following code sample removes the first candidate from the Queue.

Tip

To remove the whole Queue from the cache, refer to the Remove Data Structures from Cache page.

// Queue with this key already exists in cache
string key = "CandidateQueue";
IDistributedQueue<Candidate> retrievedQueue = cache.DataTypeManager.GetQueue<Candidate>(key);

// Remove first item of Queue
retrievedQueue.Dequeue();

// Queue with this key already exists in cache
String key = "CandidateQueue";
DistributedQueue<Candidate> retrievedQueue = cache.getDataStructuresManager().getQueue(key, Candidate.class);

// Remove first item of Queue
retrievedQueue.remove();

# Queue with this key already exists in cache
key = "CandidateQueue"

manager = cache.get_data_structures_manager()
retrieved_queue = manager.get_queue(key, Candidate)

# Remove first item of Queue
retrieved_queue.remove()

// This is an async method
// Queue with this key already exists in cache
var key = "CandidateQueue";
var manager = await this.cache.getDataStructuresManager();
var retrievedQueue = await manager.getQueue(key, ncache.JsonDataType.Object);

// Remove first item of Queue
await retrievedQueue.remove();

Note

To ensure the operation is fail-safe, it is recommended to handle any potential exceptions within your application, as explained in Handling Failures.

Remove Data in Bulk

If you want to remove multiple items in a single call, you can use the DequeueBulk method. The DequeueBulk method takes a maxitems parameter that specifies the maximum number of items to dequeue. If the Queue contains fewer items than the specified number, only the available items will be dequeued. For example, if you specify 10 but only 7 items exist, all 7 items will be dequeued. The default value for the maximum number of items is 10.

The following code sample shows how to fetch the Queue of Candidate type using the cache key CandidateQueue and how multiple items can be removed from the Queue in bulk.

Note

The DequeueBulk method ensures that the items are removed from the Queue in the same order they were added, up to the specified number.

Warning

When using the DequeueBulk method, it is recommended to only dequeue the number of items required for processing at that time. Dequeuing larger lists than necessary can increase processing time, as each operation comes with its own processing cost, especially if the Queue holds a large amount of data.

.NET

// Queue with this key already exists in cache
string key = "CandidateQueue";
IDistributedQueue<Candidate> retrievedQueue = cache.DataTypeManager.GetQueue<Candidate>(key);

// Remove at most the first 10 items in the Queue
IList<Candidate> dequeuedItems = retrievedQueue.DequeueBulk(10);

Note

If the Queue is empty during the DequeueBulk operation, an exception will be thrown.

Similar to EnqueueBulk, if any error occurs while removing an item during the DequeueBulk operation, the entire process is rolled back. The user will either receive all the requested items, or an exception will be thrown, with no items returned.

Event Notifications on Queues

You can register cache events, key-based events, and data structure events on a data structure such as a Queue. For more details, refer to feature-wise behavior.

Register Event on Queue Created

The following code sample registers a cache event of ItemAdded and ItemUpdated as well as registers an event for ItemAdded and ItemUpdated on the Queue in the cache. Once a Queue is created in the cache, an ItemAdded cache level event is fired. However, once an item is added to the Queue, an ItemAdded data structure event is fired, and an ItemUpdated cache level event is fired.

// Unique cache key for Queue
string key = "CandidateQueue";

// Create Queue of Candidate type
IDistributedQueue<Candidate> queue = cache.DataTypeManager.CreateQueue<Candidate>(key);

// Register ItemAdded, ItemUpdated, ItemRemoved events on Queue created
// DataTypeNotificationCallback is callback method specified
queue.RegisterNotification(DataTypeDataNotificationCallback, EventType.ItemAdded |
        EventType.ItemUpdated | EventType.ItemRemoved,
        DataTypeEventDataFilter.Data);

// Perform operations

// Unique cache key for the Queue
String key = "CandidateQueue";

// Create Queue of candidate type
DistributedQueue<Candidate> queue = cache.getDataStructuresManager().createQueue(key, Candidate.class);

// Create EnumSet of event types
EnumSet<EventType> enumSet = EnumSet.of(com.alachisoft.ncache.runtime.events.EventType.ItemAdded,
        EventType.ItemUpdated, EventType.ItemRemoved);

// Register ItemAdded, ItemUpdated, ItemRemoved events on Queue created
// dataChangeListener is the specified callback method
DataStructureDataChangeListener dataChangeListener = dataStructureListener.onDataStructureChanged(collectionName, args);
queue.addChangeListener(dataChangeListener, enumSet, DataTypeEventDataFilter.Data);

// Perform operations

def datastructure_callback_function(collection_name, collection_event_args):
    # Perform Operations
    print("Event Fired for " + str(collection_name))

    # Unique cache key for Queue
    key = "CandidateQueue"

    # Create Queue
    queue = cache.get_data_structures_manager().create_queue(key, Candidate)

    # Register ItemAdded, ItemUpdated, ItemRemoved events on Queue created
    events_list = [ncache.EventType.ITEM_ADDED, ncache.EventType.ITEM_UPDATED, ncache.EventType.ITEM_REMOVED]

    queue.add_change_listener(datastructure_callback_function, events_list, ncache.DataTypeEventDataFilter.DATA)

// This is an async method
// Unique cache key for the Queue
var key = "CandidateQueue";

// Create Queue of candidate type
var queue = await this.cache
.getDataStructuresManager()
.createQueue(key, ncache.JsonDataType.Object);

// Create EnumSet of event types
var enumSet = enumSet.of(
ncache.EventType.ItemAdded,
ncache.EventType.ItemUpdated,
ncache.EventType.ItemRemoved
);

// Register ItemAdded, ItemUpdated, ItemRemoved events on Queue created
// dataChangeListener is the specified callback method
var dataChangeListener = this.dataStructureListener.onDataStructureChanged(
collectionName,
args
);

queue.addChangeListener(
dataChangeListener,
enumSet,
ncache.DataTypeEventDataFilter.Data
);

// Perform operations

Specify Callback for Event Notification

The following code sample shows how to specify a callback method to receive notifications for different events, such as when an item is added, updated, or removed from a collection. By handling these events, you can trigger specific actions in response to changes within the cache.

private void DataTypeDataNotificationCallback(string collectionName, DataTypeEventArg collectionEventArgs)
{
    switch (collectionEventArgs.EventType)
    {
        case EventType.ItemAdded:
            // Item has been added to the collection
        break;
        case EventType.ItemUpdated:
            if (collectionEventArgs.CollectionItem != null)
            {
                // Item has been updated in the collection
                // Perform operations
            }
        break;
        case EventType.ItemRemoved:
            // Item has been removed from the collection
        break;
    }
}

DataStructureDataChangeListener dataStructureListener = new DataStructureDataChangeListener() {
    @Override
    public void onDataStructureChanged(String collection, DataStructureEventArg dataStructureEventArg) {
        switch (dataStructureEventArg.getEventType()) {
            case ItemAdded:
                // Item has been added to the collection
            break;
            case ItemUpdated:
                if (dataStructureEventArg.getCollectionItem() != null) {
                    //Item has been updated in the collection
                    // perform operations
                }
            break;
            case ItemRemoved:
                //Item has been removed from the collection
            break;
        }
    }
};

 def datastructure_callback_function(collection_name: str, collection_event_args: DataStructureEventArg):
    if collection_event_args.get_event_type() is ncache.EventType.ITEM_ADDED:
        # Item has been added to the collection
        print("Item added in " + collection_name)

    elif collection_event_args.get_event_type() is ncache.EventType.ITEM_UPDATED:
        # Item has been updated in the collection
        print("Item updated in " + collection_name)

    elif collection_event_args.get_event_type() is ncache.EventType.ITEM_REMOVED:
        # Item has been removed from the collection
        print("Item removed from " + collection_name)

dataStructureListener = new ncache.DataStructureDataChangeListener();
{
  function onDataStructureChanged(collection, dataStructureEventArg) {
    switch (dataStructureEventArg.getEventType()) {
      case ncache.EventType.ItemAdded:
        //Item has been added to the collection
      break;
      case ncache.EventType.ItemUpdated:
        if (dataStructureEventArg.getCollectionItem() != null) {
          //Item has been updated in the collection
          // perform operations
        }
      break;
      case ncache.EventType.ItemRemoved:
        //Item has been removed from the collection
      break;
    }
  }
}

Locking Queues

Queues can be explicitly locked and unlocked to ensure data consistency. The following code sample creates a Queue and locks it for a period of 10 seconds using Lock and then unlocks it using Unlock.

.NET
Java

// Queue exists with key "CandidateQueue" cache key
string key = "CandidateQueue";

// Get Queue
IDistributedQueue<Candidate> queue = cache.DataTypeManager.GetQueue<Candidate>(key);

// Lock Queue for 10 seconds
bool isLocked = queue.Lock(TimeSpan.FromSeconds(10));
if (isLocked)
{
    // Queue is successfully locked for 10 seconds
    // Unless explicitly unlocked
}
else
{
    // Queue is not locked because either:
    // Queue is not present in the cache
    // Queue is already locked
}

queue.Unlock();

// Queue exists with key "CandidateQueue" cache key
String key = "CandidateQueue";

// Get Queue
DistributedQueue<Candidate> queue = cache.getDataStructuresManager().getQueue(key, Candidate.class);

// Lock Queue for 10 seconds
boolean isLocked = queue.lock(TimeSpan.FromSeconds(10));
if (isLocked) {
    // Queue is successfully locked for 10 seconds
    // Unless explicitly unlocked
} else {
    // Queue is not locked because either:
    // Queue is not present in the cache
    // Queue is already locked
}
queue.unlock();

Additional Resources

NCache provides a sample application for the Queue data structure on GitHub.

Queue Behavior and Usage in Cache

Behavior

Prerequisites

Create Queue and Add Data

Tip

Create Queue and Add Data in Bulk

Note

Fetch and Perform Other Methods on the Queue

Remove Items from the Queue

Tip

Note

Remove Data in Bulk

Note

Warning

Note

Event Notifications on Queues

Register Event on Queue Created

Specify Callback for Event Notification

Locking Queues

Additional Resources

See Also

Contact Us