Uses of Class
org.openrefine.runners.local.pll.PLL
-
Packages that use PLL Package Description org.openrefine.runners.local Supplies aRunnerwhich is designed for execution on a single machine, with parallelism.org.openrefine.runners.local.pll -
-
Uses of PLL in org.openrefine.runners.local
Methods in org.openrefine.runners.local that return PLL Modifier and Type Method Description protected PLL<IndexedRow>LocalGrid. indexedRows()Methods in org.openrefine.runners.local with parameters of type PLL Modifier and Type Method Description protected <T,U extends Serializable>
Grid.PartialAggregation<U>LocalGrid. sample(PLL<T> source, long sampleSize, U initialValue, BiFunction<U,T,U> fold, BiFunction<U,U,U> combine)Compute how many partitions and how many elements in those partitions we should process, if we want to get a sample of the given size. -
Uses of PLL in org.openrefine.runners.local.pll
Subclasses of PLL in org.openrefine.runners.local.pll Modifier and Type Class Description classCroppedPLL<T>A PLL obtained by removing some rows at the beginning or the end of a PLL.classDropPartitionsPLL<T>A PLL obtained by dropping some partitions from the parent PLL.classIndexedPLL<T>A PLL indexed in sequential order.classInMemoryPLL<T>A PLL which is created out of a regular Java collection.classMapPartitionsPLL<U,T>A PLL obtained by transforming each partition independently.classOrderedJoinPLL<K,V,W>A PLL which represents the join of two others, assuming both are sorted by keys.classPairPLL<K,V>Adds additional methods for PLLs of keyed collections.classRecordPLLA PLL of records efficiently computed from the underlying PLL of rows.classSinglePartitionPLL<T>A PLL which wraps an iterable, with a single partition corresponding to the iterable itself.classTextFilePLLA PLL whose contents are read from a set of text files.classUnionPLL<T>A PLL which represents the concatenation of a sequence of other PLLsFields in org.openrefine.runners.local.pll declared as PLL Modifier and Type Field Description protected PLL<T>DropPartitionsPLL. parentprotected PLL<U>MapPartitionsPLL. parentprotected PLL<T>CroppedPLL. pllprotected PLL<Tuple2<K,V>>PairPLL. pllMethods in org.openrefine.runners.local.pll that return PLL Modifier and Type Method Description PLL<List<T>>PLL. batchPartitions(int batchSize)Groups elements by batches of the desired size, in each partition.PLL<T>PLL. concatenate(List<PLL<T>> others)Concatenates other PLLs at the end of this one, resulting in a new PLL.PLL<T>PLL. concatenate(PLL<T> other)Concatenates another PLL at the end of this one, resulting in a new PLL.PLL<T>PLL. dropFirstElements(long n)Drops the first n elements at the beginning of the collection.PLL<T>PLL. dropLastElements(long n)Drops the last n elements at the end of the collection.PLL<T>PLL. filter(Predicate<? super T> filterPredicate)Derives a new PLL by filtering the collection to only contain elements which match the supplied predicate.<U> PLL<U>PLL. flatMap(Function<T,CloseableIterator<U>> mapFunction, String mapDescription)Derives a new PLL by applying a map function on each element, which can return multiple elements of the new list.PLL<K>PairPLL. keys()Returns a PLL of the keys contained in this collection, in the same order.PLL<T>PLL. limitPartitions(long limit)Limit each partition to contain only their first N elements.<U> PLL<U>PLL. map(Function<T,U> mapFunction, String mapDescription)Derives a new PLL by applying a map function on each element of this list.<U> PLL<U>PLL. mapPartitions(BiFunction<Integer,CloseableIterator<T>,CloseableIterator<U>> map, String mapDescription, boolean preservesSizes)Maps each partition by applying an arbitrary function to it.<T> PLL<T>PLLContext. parallelize(int numPartitions, List<T> rows)Turns a regular list into a Partitioned Lazy List.PLL<T>PLL. retainPartitions(List<Integer> partitionIds)Only retain partitions designated by the given list of indices.<S,U>
PLL<U>PLL. scanMap(S initialState, Function<T,S> feed, BiFunction<S,S,S> combine, BiFunction<S,T,U> map)Applies a map function on the list, such that the map function is able to keep a state from one element to the other.<T> PLL<T>PLLContext. singlePartitionPLL(CloseableIterable<T> iterable, long itemCount)Turns a closeable iterable into a Partitioned Lazy List, which has a single partition.PLL<T>PLL. sort(Comparator<T> comparator)Sorts the collection using the supplied comparator.PLL<Tuple2<K,V>>PairPLL. toPLL()Returns the underlying PLL, discarding any partitioner.PLL<V>PairPLL. values()Returns a PLL of the values contained in this collection, in the same order.PLL<T>PLL. withCachedPartitionSizes(io.vavr.collection.Array<Long> partitionSizes)Sets the partition sizes if they are already known by the user.Methods in org.openrefine.runners.local.pll that return types with arguments of type PLL Modifier and Type Method Description List<PLL<?>>CroppedPLL. getParents()List<PLL<?>>DropPartitionsPLL. getParents()List<PLL<?>>IndexedPLL. getParents()List<PLL<?>>InMemoryPLL. getParents()List<PLL<?>>MapPartitionsPLL. getParents()List<PLL<?>>OrderedJoinPLL. getParents()List<PLL<?>>PairPLL. getParents()Returns directly the parents of the underlying PLL of this PairPLL, so that the PairPLL wrapper is transparent in query trees.abstract List<PLL<?>>PLL. getParents()Returns the PLLs that this PLL depends on, to compute its contents.List<PLL<?>>RecordPLL. getParents()List<PLL<?>>SinglePartitionPLL. getParents()List<PLL<?>>TextFilePLL. getParents()List<PLL<?>>UnionPLL. getParents()Methods in org.openrefine.runners.local.pll with parameters of type PLL Modifier and Type Method Description PLL<T>PLL. concatenate(PLL<T> other)Concatenates another PLL at the end of this one, resulting in a new PLL.static <T> PairPLL<Long,T>IndexedPLL. index(PLL<T> pll)Create an indexed PLL by indexing an existing PLL.Method parameters in org.openrefine.runners.local.pll with type arguments of type PLL Modifier and Type Method Description PLL<T>PLL. concatenate(List<PLL<T>> others)Concatenates other PLLs at the end of this one, resulting in a new PLL.Constructors in org.openrefine.runners.local.pll with parameters of type PLL Constructor Description CroppedPLL(PLL<T> parent, io.vavr.collection.Array<Long> newPartitionSizes, int partitionsToDrop, long dropItems, boolean atEnd)Constructs a cropped PLL by removing rows at the beginning or the end of a PLL.DropPartitionsPLL(PLL<T> parent, List<Integer> retainedPartitionIds)Constructor.IndexedPLL(PLL<T> parent)MapPartitionsPLL(PLL<U> parent, BiFunction<Integer,CloseableIterator<U>,CloseableIterator<T>> mapFunction, String mapFunctionDescription)Constructs a PLL with partitions derived one-to-one from the parent.MapPartitionsPLL(PLL<U> parent, BiFunction<Integer,CloseableIterator<U>,CloseableIterator<T>> mapFunction, String mapFunctionDescription, boolean preservesSizes)Constructs a PLL with partitions derived one-to-one from the parent.PairPLL(PLL<Tuple2<K,V>> pll, Optional<Partitioner<K>> partitioner)PairPLL(PLL<Tuple2<K,V>> pll, Optional<Partitioner<K>> partitioner, io.vavr.collection.Array<Long> partitionSizes)Constructor parameters in org.openrefine.runners.local.pll with type arguments of type PLL Constructor Description UnionPLL(List<PLL<T>> parents)Constructor.
-