Skip to content
This repository was archived by the owner on Sep 26, 2023. It is now read-only.

Commit 8c062bc

Browse files
authored
Merge pull request #20 from intenthq/upgrade-deps
Upgrade dependencies, SBT.
2 parents 9caa47d + 3958f91 commit 8c062bc

File tree

27 files changed

+71
-589
lines changed

27 files changed

+71
-589
lines changed

README.md

Lines changed: 6 additions & 36 deletions
Original file line numberDiff line numberDiff line change
@@ -12,29 +12,24 @@ The following top level dependencies are published in Maven central:
1212

1313
**Thrift support**:
1414
```
15-
"com.intenthq.pucket" %% "pucket-thrift" % "1.7.1"
16-
```
17-
18-
**Avro support**:
19-
```
20-
"com.intenthq.pucket" %% "pucket-avro" % "1.7.1"
15+
"com.intenthq.pucket" %% "pucket-thrift" % "1.8.0"
2116
```
2217

2318
**Spark connectors**:
2419
```
25-
"com.intenthq.pucket" %% "pucket-spark" % "1.7.1"
20+
"com.intenthq.pucket" %% "pucket-spark" % "1.8.0"
2621
```
2722

2823
**MapReduce integration**:
2924
```
30-
"com.intenthq.pucket" %% "pucket-mapreduce" % "1.7.1"
25+
"com.intenthq.pucket" %% "pucket-mapreduce" % "1.8.0"
3126
```
3227

3328
These dependencies should be combined depending on your usages; for example if you use Thrift and Spark then use the following:
3429

3530
```
36-
"com.intenthq.pucket" %% "pucket-thrift" % "1.7.1"
37-
"com.intenthq.pucket" %% "pucket-spark" % "1.7.1"
31+
"com.intenthq.pucket" %% "pucket-thrift" % "1.8.0"
32+
"com.intenthq.pucket" %% "pucket-spark" % "1.8.0"
3833
```
3934

4035

@@ -56,7 +51,7 @@ With Pucket we aim to provide the following high level features, broken down int
5651

5752
### Pucket High Level Concepts and Usage Considerations
5853

59-
Pucket's implementation is centered around a few key concepts described below. These may be a one time implementation in the core functionality or is partially implemented and requires specific implementation per data format. Current Pucket supports Avro and Thrift, but can be easily extended to support Protocol Buffers.
54+
Pucket's implementation is centered around a few key concepts described below. These may be a one time implementation in the core functionality or is partially implemented and requires specific implementation per data format. Current Pucket has built-in support for Thrift, but can be easily extended to support Protocol Buffers.
6055

6156
#### Pucket
6257

@@ -136,8 +131,6 @@ The following examples use the imports listed below:
136131
```scala
137132
import com.intenthq.pucket.thrift.ThriftPucket
138133
import com.intenthq.pucket.thrift.ThriftPucketDescriptor
139-
import com.intenthq.pucket.avro.AvroPucket
140-
import com.intenthq.pucket.avro.AvroPucketDescriptor
141134
import org.apache.parquet.hadoop.metadata.CompressionCodecName
142135
import org.apache.hadoop.fs.{FileSystem, Path}
143136
import scalaz.\/
@@ -149,8 +142,6 @@ You should also make sure you have created the following classes:
149142
```scala
150143
import your.thrift.ThriftData
151144
import your.pucket.ThriftPartitioner
152-
import your.avro.AvroData
153-
import your.pucket.AvroPartitioner
154145
```
155146

156147
The following values have also been created:
@@ -186,27 +177,6 @@ val maybeExistingThriftPucket: Throwable \/ Pucket[ThriftData] =
186177

187178
```
188179

189-
Create or find an Avro Pucket:
190-
191-
```scala
192-
193-
val avroDescriptor: AvroPucketDescriptor[AvroData] =
194-
AvroPucketDescriptor[AvroData](AvroData.getClassSchema,
195-
CompressionCodecName.SNAPPY,
196-
Some(AvroPartitioner))
197-
198-
val newAvroPucket: Throwable \/ Pucket[AvroData] =
199-
AvroPucket.create[AvroData](path, fs, avroDescriptor)
200-
201-
val existingAvroPucket: Throwable \/ Pucket[AvroData]
202-
AvroPucket[AvroData](path, fs, AvroData.getClassSchema)
203-
204-
val maybeExistingAvroPucket: Throwable \/ Pucket[AvroData] =
205-
AvroPucket.findOrCreate[AvroData](path, fs, avroDescriptor)
206-
207-
208-
```
209-
210180
### Writing to a Pucket
211181

212182

avro/src/main/avro/test.avdl

Lines changed: 0 additions & 10 deletions
This file was deleted.

avro/src/main/scala/com/intenthq/pucket/avro/AvroPucket.scala

Lines changed: 0 additions & 75 deletions
This file was deleted.

avro/src/main/scala/com/intenthq/pucket/avro/AvroPucketDescriptor.scala

Lines changed: 0 additions & 65 deletions
This file was deleted.

avro/src/main/scala/com/intenthq/pucket/avro/mapreduce/AvroPucketInstantiator.scala

Lines changed: 0 additions & 18 deletions
This file was deleted.

avro/src/main/scala/com/intenthq/pucket/avro/writer/AvroWriter.scala

Lines changed: 0 additions & 54 deletions
This file was deleted.

avro/src/test/scala/com/intenthq/pucket/avro/AvroPucketDescriptorSpec.scala

Lines changed: 0 additions & 52 deletions
This file was deleted.

0 commit comments

Comments
 (0)