Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve documentation #1

Open
wants to merge 1 commit into
base: master
Choose a base branch
from
Open

Improve documentation #1

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 4 additions & 4 deletions DataSetCreator/S2RDF_DataSetCreator/src/main/scala/DataSetGenerator.scala
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -45,7 +45,7 @@ object DataSetGenerator {

// create or load TripleTable if already created
if (datasetType == "VP") createTT() else loadTT()
// extarct all unique predicates from TripleTable
// extract all unique predicates from TripleTable
// necessary for VP/ExtVP generation
_uPredicates = _sqlContext.sql("select distinct pred from triples")
.map(t => t(0).toString())
Expand All @@ -56,9 +56,9 @@ object DataSetGenerator {
// create or load Vertical Partitioning if already exists
if (datasetType == "VP") createVP() else loadVP()

// if we create/recreate VP than we gonna later probably create/recreate
// ExtVP. Out of this reason we remove ExtVP directory containing old tables
// and create it empty again
// If we create/recreate the VP then later we are going to want to create/recreate
// ExtVP, so we destroy the ExtVP directory containing old tables
// and recreate them again
if (datasetType == "VP"){
Helper.removeDirInHDFS(Settings.extVpDir)
Helper.createDirInHDFS(Settings.extVpDir)
Expand Down