Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update versions for move to GeoTrellis 1.2.0-rc1 #45

Open
wants to merge 7 commits into
base: master
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 4 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -16,12 +16,15 @@ the tile ingest process and demo server to query ingested data.
To provision a VM and fetch our pre-ingested demo data:

```bash
# Add a geotrellis-site AWS profile
$ aws --profile geotrellis-site configure
$ ./scripts/setup
$ vagrant ssh
```

This will download data into `./service/geotrellis/data/chatta-demo`. See the [ingest](#ingesting-data) sections for information about ingesting data manually using either the [local filesystem](#local-ingest) or [geodocker](geodocker-ingest).

***NOTE:*** due to transient permissions issues with `NFS` and Vagrant shared folders on Linux hosts, this project uses `rsync` shared folders. In order to continuously sync your changes into the VM, open this project in another shell window/tab, and run `vagrant rsync-auto`.

## Scripts

Helper and development scripts are located in the `./scripts` directory at the root of this project. These scripts are designed to encapsulate and perform commonly used actions such as starting a development server, accessing a development console, or running tests.
Expand Down
10 changes: 8 additions & 2 deletions Vagrantfile
Original file line number Diff line number Diff line change
Expand Up @@ -2,6 +2,7 @@
# vi: set ft=ruby :

ANSIBLE_VERSION = "2.3.1.0"

Vagrant.configure("2") do |config|

# Ubuntu 14.04 LTS
Expand All @@ -19,8 +20,13 @@ Vagrant.configure("2") do |config|
vb.cpus = 2
end

config.vm.synced_folder "./", "/vagrant", type: "rsync",
rsync__exclude: ["deployment/ansible/roles/azavea.*/",
"service/geotrellis/target/",
"service/geotrellis/project/target"],
rsync__args: ["--verbose", "--archive", "-z"]
config.vm.synced_folder "~/.aws", "/home/vagrant/.aws"
config.vm.synced_folder "./", "/home/vagrant/geotrellis-chatta-demo", type: "nfs"


# Provisioning
# Ansible is installed automatically by Vagrant.
Expand All @@ -35,7 +41,7 @@ Vagrant.configure("2") do |config|

config.vm.provision "shell" do |s|
s.path = 'deployment/vagrant/cd_shared_folder.sh'
s.args = "/home/vagrant/geotrellis-chatta-demo"
s.args = "/vagrant"
end

end
4 changes: 2 additions & 2 deletions scripts/setup
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@ if [ "${BASH_SOURCE[0]}" = "${0}" ]; then
if [ "${1:-}" = "--help" ]; then
usage
else
vagrant up --provision
vagrant ssh -c "cd /home/vagrant/geotrellis-chatta-demo && ./scripts/update"
#vagrant up --provision
vagrant ssh -c "cd /vagrant && ./scripts/update"
fi
fi
15 changes: 10 additions & 5 deletions service/geotrellis/build.sbt
Original file line number Diff line number Diff line change
Expand Up @@ -16,18 +16,23 @@ publishMavenStyle := true
publishArtifact in Test := false
pomIncludeRepository := { _ => false }

val gtVersion = "1.1.0-RC2"
val akkaActorVersion = "2.4.17"
val akkaHttpVersion = "10.0.3"
val gtVersion = "1.2.0-RC1"
val akkaActorVersion = "2.5.6"
val akkaHttpVersion = "10.0.10"

resolvers ++= Seq(
"locationtech-releases" at "https://repo.locationtech.org/content/groups/releases"
)

libraryDependencies ++= Seq(
"org.locationtech.geotrellis" %% "geotrellis-spark-etl" % gtVersion,
"com.typesafe.akka" %% "akka-actor" % akkaActorVersion,
"com.typesafe.akka" %% "akka-stream" % akkaActorVersion,
"com.typesafe.akka" %% "akka-http-core" % akkaHttpVersion,
"com.typesafe.akka" %% "akka-http" % akkaHttpVersion,
"com.typesafe.akka" %% "akka-http-spray-json" % akkaHttpVersion,
"org.apache.spark" %% "spark-core" % "2.1.0",
"org.apache.hadoop" % "hadoop-client" % "2.7.3"
"org.apache.spark" %% "spark-core" % "2.1.1",
"org.apache.hadoop" % "hadoop-client" % "2.8.2"
)

assemblyShadeRules in assembly := {
Expand Down
2 changes: 1 addition & 1 deletion service/geotrellis/project/build.properties
Original file line number Diff line number Diff line change
@@ -1 +1 @@
sbt.version=0.13.13
sbt.version=0.13.16
6 changes: 3 additions & 3 deletions service/geotrellis/project/plugins.sbt
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
addSbtPlugin("com.eed3si9n" % "sbt-assembly" % "0.14.4")
addSbtPlugin("com.eed3si9n" % "sbt-assembly" % "0.14.5")

addSbtPlugin("net.virtual-void" % "sbt-dependency-graph" % "0.8.2")
addSbtPlugin("net.virtual-void" % "sbt-dependency-graph" % "0.9.0")

addSbtPlugin("com.timushev.sbt" % "sbt-updates" % "0.3.0")
addSbtPlugin("com.timushev.sbt" % "sbt-updates" % "0.3.3")

Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ package object chatta {
case "hbase" => {
val instance = HBaseInstance(
config.getString("hbase.zookeepers").split(","),
config.getString("accumulo.master")
config.getString("hbase.master")
)

(HBaseLayerReader(instance), HBaseValueReader(instance), HBaseAttributeStore(instance))
Expand Down Expand Up @@ -86,7 +86,7 @@ package object chatta {
case "hbase" => {
val instance = HBaseInstance(
config.getString("hbase.zookeepers").split(","),
config.getString("accumulo.master")
config.getString("hbase.master")
)

(HBaseCollectionLayerReader(instance), HBaseValueReader(instance), HBaseAttributeStore(instance))
Expand Down