Keyboard shortcuts

Press ← or → to navigate between chapters

Press S or / to search in the book

Press ? to show this help

Press Esc to hide this help

Settings and defaults

Each setting of each function, its default, and where the default comes from. The reference pages give every permitted value.

functionsettingdefaultsource of the default
harvestmin_words / max_words4 / 80old cleaning notebook
extract_doisfirst_pages / save2 / Nonethe paper’s own DOI is on page 1 (checked by hand: 7 of 7)
extract_referencessave / cacheNone / True214 of 215 DOIs of the sample papers exist at doi.org
download_paperslicencesNone["cc-by"] keeps only CC BY papers (see A snowball round)
download_paperssourcesNoneNone = the nine free sources, from openalex to landing_page; add tmsr-doi-downloader
download_papersrespect_robotsTrueobey robots.txt; set False only with the right to do so
download_papersemailNonethe polite pool of OpenAlex and Crossref, and Unpaywall; None keeps UNPAYWALL_EMAIL
causenetthreshold0.8old pipeline sweep 0.5–0.8
causenetmodeneuralmodel card default
causenetdecisionspan_onlysince 0.2.0 (cls+span before): a cause span and an effect span are enough
causenetavoid_ambiguousTruesince 0.2.0: skip a relation with a pointer span (“this”, “it”)
causenetbatch_size / device64 / autoauto = an NVIDIA GPU, else an Apple GPU, else the CPU
all harmonizerembeddingsallmpnetPaper 3; bge_base scores 0.02 F1 higher (Thesaurus strategies, section 5)
standardize_*taxonomyelsstproject choice; the only built-in thesaurus
standardize_*strategyenrichedPaper 3 web tool; confirmed by the held-out test
standardize_*top5project choice
standardize_*leaves_onlyFalsesince 0.2.0 (True before): broad concepts too, such as TRUST and MOTIVATION
label_groupsby / topkeywords / 3since 0.2.0 (both before): the TF-IDF keywords of the group
standardize_*thresholdNonesince 0.2.0; None gives every span its best concept
standardize_groupsname_bymean_simold pipeline’s cluster-naming comparison
pairwise_groupingthreshold0.69Paper 3 BEST_PAIRWISE_THRESHOLDS
pairwise_groupinglinkageaveragesince 0.2.0 (single before): single linkage chains (see Group and name constructs)
clusterermin_cluster_size / min_samples2 / 2Paper 3 BEST_CLUSTERING_PARAMS
clustererumapNonePaper 3; the best run had no reduction
causal_mapmin_papers / min_sentences1 / 2project choice; 1 paper works for one long book
causal_mapmin_share0.67project choice: a two-way pair needs 2 papers to 1 for one direction
draw_mapsave / heightNone / 720a notebook shows the page; a script writes causal_map.html

τ, the score that a span needs for a thesaurus concept, is the threshold of the standardize_* functions. It is off by default. Choose it per model, per strategy, per thesaurus. The evidence behind the defaults is in Thesaurus strategies, section 5.