Results Checker avatar

Results Checker

Try for free

No credit card required

View all Actors
Results Checker

Results Checker

lukaskrivka/results-checker
Try for free

No credit card required

Check the results of your scrapers with this flexible checker. Just supply a dataset or key-value store ID and a few simple rules to get a detailed report.

Apify Storage ID

apifyStorageIdstringOptional

Id of dataset or key value store where the data are located.

Record Key

recordKeystringOptional

Only specify if Apify storage id points to a key value store! This is the record key under which the data are.

Raw Data

rawDataarrayOptional

Raw JSON array you want to check.

Functional Checker

functionalCheckerstringRequired

Function that returns an object with item fields as keys and values as predicates (functions that return true/false)

Context

contextobjectOptional

Custom object where you can put any value that will be accessible in functional checker functions as third parameter. Useful for dynamic values coming from other actors.

Identification Fields

identificationFieldsarrayOptional

You can specify which fields should display in the debug OUTPUT to identify bad items. By default it shows all fields which may make it unnecessary big.

Minimal success rate

minimalSuccessRateobjectOptional

You can specify minimal success rate (0 to 1) of any field. If the success rate will be higher than this, the field will not be count as bad field. This needs t obe an object with fields as keys and success rate as values.

No extra fields

noExtraFieldsbooleanOptional

If checked on, the actor will consider extra fields as bad fields. Uncheck if you don't mind them

Default value of this property is true

Limit

limitintegerOptional

How many items will be checked. Default is all

Offset

offsetintegerOptional

From which item the checking will start. Use with limit to check specific items.

Batch Size

batchSizeintegerOptional

You can change number of loaded and processed items in each batch. This is only needed if you have really huge items.

Default value of this property is 50000

Max bad items saved

maxBadItemsSavedintegerOptional

Sets how big report you get for each unique combination of bad fields. Keeping this small and running it again after fixing some is the best approach. It speeds up the actor and reduces memory need.

Default value of this property is 20

Developer
Maintained by Community

Actor Metrics

  • 1 monthly user

  • 8 stars

  • Created in May 2019

  • Modified 4 years ago

Categories