BatchOperation that allows a BatchGet and Delete?

0xMartian · January 12, 2021, 11:28pm

New to the community and have been poking around the source code of the golang client library for a while.

I am wondering if there is a function to preform multiple operations using batchget. In the docs (and the code in client.go) there is a way to preform a Get and Delete in a single request to the database, but this functionality seems to not be there for a ‘BatchGet’. I am piecing together an idea that involves calling calling a stream UDF on the result of my batchget, but it seems the ‘aerospike way’ is to use the operations api.

Furthermore, is there a way to limit the amount of requests returned by a query? What is the aerospike way to retrieve records in batches without preforming a full scan? I have the taste of an idea that involves ending the stream inside a UDF once X number of records have passed through it, is this the right direction?

In short, looking for a BatchOperation that will allow a ‘BatchGet’ and ‘BatchDelete’ and a way to limit the amount of results from a query.

Khosrow_Afroozeh · January 13, 2021, 11:08am

BatchGet is only to perform fetch operations.
You can perform multiple operations via QueryExecute adding Policy.FilterExpressions.
We are going to release a feature on the client soon that allow you to perform limited scans. At the moment, you can query and then close the recordset when you have enough records.

0xMartian · January 13, 2021, 10:20pm

Hey, im not sure how to chain commands through the FilterExpression. If I wanted to change the value of a bin for each record how would I do that?

Khosrow_Afroozeh · January 14, 2021, 5:43pm

If you could mention your exact use case, I’d be able to to help you more specifically. If your use-case involves complicated operations or getting the results back right after change, the only way to do it would be to use a Stream UDF (with its performance implications) If it can be done using simple Operations and does not involve fetching back the results, then you can use ExecuteQuery via FilterExpressions. You can see examples here:

github.com

aerospike/aerospike-client-go/blob/master/expression_test.go

// Copyright 2017-2019 Aerospike, Inc.
//
// Licensed under the Apache License, Version 2.0 (the "License");
// you may not use this file except in compliance with the License.
// You may obtain a copy of the License at
//
// http://www.apache.org/licenses/LICENSE-2.0
//
// Unless required by applicable law or agreed to in writing, software
// distributed under the License is distributed on an "AS IS" BASIS,
// WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
// See the License for the specific language governing permissions and
// limitations under the License.

package aerospike_test

import (
	"fmt"

	as "github.com/aerospike/aerospike-client-go"

This file has been truncated. show original

Don’t hesitate to ask in case you have further questions.

Topic		Replies	Views
How to do multiple filtering Go Client	6	4776	May 20, 2015
Batch Remove (AER-6499) Delivered Requests	10	4079	June 9, 2022
Delete keys from many sets in one request Operations query	4	1296	December 17, 2021
Multiple ops on same bin of a record Python Client query , udf	2	932	September 6, 2021
Delete record instantly while reading that record using java client in aerospike set deletion , query , secondary , udf	3	1766	June 24, 2019

BatchOperation that allows a BatchGet and Delete?

Related topics