Uses of Class
org.openrefine.runners.local.pll.PLL
-
Packages that use PLL Package Description org.openrefine.runners.local Supplies aRunner
which is designed for execution on a single machine, with parallelism.org.openrefine.runners.local.pll -
-
Uses of PLL in org.openrefine.runners.local
Methods in org.openrefine.runners.local that return PLL Modifier and Type Method Description protected PLL<IndexedRow>
LocalGrid. indexedRows()
Methods in org.openrefine.runners.local with parameters of type PLL Modifier and Type Method Description protected <T,U extends Serializable>
Grid.PartialAggregation<U>LocalGrid. sample(PLL<T> source, long sampleSize, U initialValue, BiFunction<U,T,U> fold, BiFunction<U,U,U> combine)
Compute how many partitions and how many elements in those partitions we should process, if we want to get a sample of the given size. -
Uses of PLL in org.openrefine.runners.local.pll
Subclasses of PLL in org.openrefine.runners.local.pll Modifier and Type Class Description class
CroppedPLL<T>
A PLL obtained by removing some rows at the beginning or the end of a PLL.class
DropPartitionsPLL<T>
A PLL obtained by dropping some partitions from the parent PLL.class
IndexedPLL<T>
A PLL indexed in sequential order.class
InMemoryPLL<T>
A PLL which is created out of a regular Java collection.class
MapPartitionsPLL<U,T>
A PLL obtained by transforming each partition independently.class
OrderedJoinPLL<K,V,W>
A PLL which represents the join of two others, assuming both are sorted by keys.class
PairPLL<K,V>
Adds additional methods for PLLs of keyed collections.class
RecordPLL
A PLL of records efficiently computed from the underlying PLL of rows.class
SinglePartitionPLL<T>
A PLL which wraps an iterable, with a single partition corresponding to the iterable itself.class
TextFilePLL
A PLL whose contents are read from a set of text files.class
UnionPLL<T>
A PLL which represents the concatenation of a sequence of other PLLsFields in org.openrefine.runners.local.pll declared as PLL Modifier and Type Field Description protected PLL<T>
DropPartitionsPLL. parent
protected PLL<U>
MapPartitionsPLL. parent
protected PLL<T>
CroppedPLL. pll
protected PLL<Tuple2<K,V>>
PairPLL. pll
Methods in org.openrefine.runners.local.pll that return PLL Modifier and Type Method Description PLL<List<T>>
PLL. batchPartitions(int batchSize)
Groups elements by batches of the desired size, in each partition.PLL<T>
PLL. concatenate(List<PLL<T>> others)
Concatenates other PLLs at the end of this one, resulting in a new PLL.PLL<T>
PLL. concatenate(PLL<T> other)
Concatenates another PLL at the end of this one, resulting in a new PLL.PLL<T>
PLL. dropFirstElements(long n)
Drops the first n elements at the beginning of the collection.PLL<T>
PLL. dropLastElements(long n)
Drops the last n elements at the end of the collection.PLL<T>
PLL. filter(Predicate<? super T> filterPredicate)
Derives a new PLL by filtering the collection to only contain elements which match the supplied predicate.<U> PLL<U>
PLL. flatMap(Function<T,CloseableIterator<U>> mapFunction, String mapDescription)
Derives a new PLL by applying a map function on each element, which can return multiple elements of the new list.PLL<K>
PairPLL. keys()
Returns a PLL of the keys contained in this collection, in the same order.PLL<T>
PLL. limitPartitions(long limit)
Limit each partition to contain only their first N elements.<U> PLL<U>
PLL. map(Function<T,U> mapFunction, String mapDescription)
Derives a new PLL by applying a map function on each element of this list.<U> PLL<U>
PLL. mapPartitions(BiFunction<Integer,CloseableIterator<T>,CloseableIterator<U>> map, String mapDescription, boolean preservesSizes)
Maps each partition by applying an arbitrary function to it.<T> PLL<T>
PLLContext. parallelize(int numPartitions, List<T> rows)
Turns a regular list into a Partitioned Lazy List.PLL<T>
PLL. retainPartitions(List<Integer> partitionIds)
Only retain partitions designated by the given list of indices.<S,U>
PLL<U>PLL. scanMap(S initialState, Function<T,S> feed, BiFunction<S,S,S> combine, BiFunction<S,T,U> map)
Applies a map function on the list, such that the map function is able to keep a state from one element to the other.<T> PLL<T>
PLLContext. singlePartitionPLL(CloseableIterable<T> iterable, long itemCount)
Turns a closeable iterable into a Partitioned Lazy List, which has a single partition.PLL<T>
PLL. sort(Comparator<T> comparator)
Sorts the collection using the supplied comparator.PLL<Tuple2<K,V>>
PairPLL. toPLL()
Returns the underlying PLL, discarding any partitioner.PLL<V>
PairPLL. values()
Returns a PLL of the values contained in this collection, in the same order.PLL<T>
PLL. withCachedPartitionSizes(io.vavr.collection.Array<Long> partitionSizes)
Sets the partition sizes if they are already known by the user.Methods in org.openrefine.runners.local.pll that return types with arguments of type PLL Modifier and Type Method Description List<PLL<?>>
CroppedPLL. getParents()
List<PLL<?>>
DropPartitionsPLL. getParents()
List<PLL<?>>
IndexedPLL. getParents()
List<PLL<?>>
InMemoryPLL. getParents()
List<PLL<?>>
MapPartitionsPLL. getParents()
List<PLL<?>>
OrderedJoinPLL. getParents()
List<PLL<?>>
PairPLL. getParents()
Returns directly the parents of the underlying PLL of this PairPLL, so that the PairPLL wrapper is transparent in query trees.abstract List<PLL<?>>
PLL. getParents()
Returns the PLLs that this PLL depends on, to compute its contents.List<PLL<?>>
RecordPLL. getParents()
List<PLL<?>>
SinglePartitionPLL. getParents()
List<PLL<?>>
TextFilePLL. getParents()
List<PLL<?>>
UnionPLL. getParents()
Methods in org.openrefine.runners.local.pll with parameters of type PLL Modifier and Type Method Description PLL<T>
PLL. concatenate(PLL<T> other)
Concatenates another PLL at the end of this one, resulting in a new PLL.static <T> PairPLL<Long,T>
IndexedPLL. index(PLL<T> pll)
Create an indexed PLL by indexing an existing PLL.Method parameters in org.openrefine.runners.local.pll with type arguments of type PLL Modifier and Type Method Description PLL<T>
PLL. concatenate(List<PLL<T>> others)
Concatenates other PLLs at the end of this one, resulting in a new PLL.Constructors in org.openrefine.runners.local.pll with parameters of type PLL Constructor Description CroppedPLL(PLL<T> parent, io.vavr.collection.Array<Long> newPartitionSizes, int partitionsToDrop, long dropItems, boolean atEnd)
Constructs a cropped PLL by removing rows at the beginning or the end of a PLL.DropPartitionsPLL(PLL<T> parent, List<Integer> retainedPartitionIds)
Constructor.IndexedPLL(PLL<T> parent)
MapPartitionsPLL(PLL<U> parent, BiFunction<Integer,CloseableIterator<U>,CloseableIterator<T>> mapFunction, String mapFunctionDescription)
Constructs a PLL with partitions derived one-to-one from the parent.MapPartitionsPLL(PLL<U> parent, BiFunction<Integer,CloseableIterator<U>,CloseableIterator<T>> mapFunction, String mapFunctionDescription, boolean preservesSizes)
Constructs a PLL with partitions derived one-to-one from the parent.PairPLL(PLL<Tuple2<K,V>> pll, Optional<Partitioner<K>> partitioner)
PairPLL(PLL<Tuple2<K,V>> pll, Optional<Partitioner<K>> partitioner, io.vavr.collection.Array<Long> partitionSizes)
Constructor parameters in org.openrefine.runners.local.pll with type arguments of type PLL Constructor Description UnionPLL(List<PLL<T>> parents)
Constructor.
-