public interface CrawlData extends LazyAXML<CrawlData,Document>
crawl-data component. Single
crawl-url typically contains two crawl-data, one for metadata
and the other for actual data, distinguished by their content-type.
For accessing child document components from crawl-data object, use
one of forEach, forEachBuild and map.| Modifier and Type | Interface and Description |
|---|---|
static interface |
CrawlData.Builder
Builder for new
crawl-data. |
AXMLBase.Publisher<T>| Modifier and Type | Method and Description |
|---|---|
CrawlData.Builder |
build(java.util.function.Consumer<AXMLBase.Publisher<? super Document>> generator)
Build a new instance of this class by calculating child components lazily.
|
CrawlData.Builder |
copy()
Create a builder for new AXML component cloned from
this object. |
CrawlData.Builder |
forEachBuild(java.util.function.BiConsumer<Document,AXMLBase.Publisher<? super Document>> mapper)
Build a new instance of this class whose contents are calculated lazily.
|
java.lang.String |
getContentType()
Get
content-type of documents in this crawl-data. |
CrawlData.Builder |
map(java.util.function.Function<? super Document,? extends Document> mapper) |
getAcl, getGroupID, getUrljava.lang.String getContentType()
content-type of documents in this crawl-data.content-typeCrawlData.Builder build(java.util.function.Consumer<AXMLBase.Publisher<? super Document>> generator)
LazyAXML... in
data.build((Publisher<T> publisher) -> ... ) to generate the enclosed
children, runs when their values are required.CrawlData.Builder forEachBuild(java.util.function.BiConsumer<Document,AXMLBase.Publisher<? super Document>> mapper)
LazyAXMLbuild and
forEach. I.e.,
data.forEachBuild((T document, Publisher<T> publisher) -> ... )
is the same as
data.build((Publisher<T> publisher) -> data.forEach((T document) -> ... )) .forEachBuild in interface LazyAXML<CrawlData,Document>CrawlData.Builder map(java.util.function.Function<? super Document,? extends Document> mapper)