Apache Parquet

@ApacheParquet

language agnostic, open source Columnar file format for analytics

parquet.io
Joined April 2013
2 Photos and videos Photos and videos

Tweets

You blocked @ApacheParquet

Are you sure you want to view these Tweets? Viewing Tweets won't unblock @ApacheParquet

  1. Retweeted
    6 Nov 2018

    PSA: If you use the page-level statistics in please chime in on JIRA:

    3 retweets 1 like
    Undo
  2. Retweeted
    25 Jul 2018

    Last speaker on the 's scientific room before lunch is Peter Hoffmann talking about#Pandas and to work with large datasets in .

    2 replies 18 retweets 34 likes
    Undo
  3. Retweeted
    30 Jul 2018
    Replying to and

    Have a look at the bucketing sink rework for the upcoming release and the Parquet writer ;)

    4 replies 2 retweets 4 likes
    Undo
  4. Retweeted
    18 Jun 2018

    Can someone answere this -> why is format faster than other columnar storage like hbase, kudu etc?

    1 reply 3 retweets 5 likes
    Undo
  5. Retweeted
    2 Jul 2018

    My talk from the DMBI 2018 Conference at about our journey at to Analytics on is available at . Thanks everyone for attending!

    2 retweets 2 likes
    Undo
  6. Retweeted
    19 Apr 2018

    How big data is?? Well... after filtering the collisions, they generate 12.3 PB in a month... Special ROOT format +

    10 retweets 21 likes
    Undo
  7. Retweeted
    23 Apr 2018

    In one month from now I'll be speaking on big data journey with and at the Conference in London. If you're there, drop by!

    1 retweet 2 likes
    Undo
  8. Retweeted
    28 Apr 2018

    2nd - & walk us through a zoo of for & in : , , , , &

    11 retweets 27 likes
    Undo
  9. Retweeted
    27 Mar 2018

    Join the accelerated and revolution. and

    7 retweets 10 likes
    Undo
  10. Retweeted
    26 Mar 2018

    Great benchmark between on and In short kudu is faster than Parquet for random access Querys like CRUD operations but slower for analytics queries.

    1 reply 10 retweets 12 likes
    Undo
  11. Retweeted
    5 Mar 2018

    If you’re a company using open source projects and not sure how to contribute, a release engineer would be a tremendous help. It’s hard to do this properly part time. I have a specific project in mind, if you need a hint.

    9 retweets 11 likes
    Undo
  12. Retweeted
    28 Feb 2018

    You do not need Spark to create files, you can use plain Java and it can even fit in AWS Lambda for a serverless solution:

    6 retweets 14 likes
    Undo
  13. Retweeted
    5 Mar 2017

    Learn how to use hive views for advanced schema evolution

    1 retweet 2 likes
    Undo
  14. Retweeted
    1 Feb 2018

    Is there a way to from mssql to as a parquet directly?

    3 replies 2 retweets 2 likes
    Undo
  15. Retweeted
    11 Jan 2018

    I'll be speaking at Conference this May in London, and share our journey in one of our many adventures with . You're all invited!

    1 retweet 4 likes
    Undo
  16. Retweeted
    4 Jan 2018

    I wonder if we have in

    Working with a 10Gig csv data. Pandas read_csv took 16mins to load the csv into memory. Converted to with . It took 30 secs to read into pyarrow table and 16 sec to convert to pandas dataframe. 16mins => 46sec!
    Show this thread
    1 reply 6 retweets 7 likes
    Undo
  17. Retweeted
    4 Jan 2018

    Also the file size went down from 10Gigs to 3Gigs without any compression.

    1 reply 6 retweets 19 likes
    Show this thread
    Show this thread
    Undo
  18. Retweeted
    4 Jan 2018

    Working with a 10Gig csv data. Pandas read_csv took 16mins to load the csv into memory. Converted to with . It took 30 secs to read into pyarrow table and 16 sec to convert to pandas dataframe. 16mins => 46sec!

    16 replies 165 retweets 587 likes
    Show this thread
    Show this thread
    Undo
  19. Retweeted
    7 Dec 2017

    Come hear me talk about and at in Palo Alto next Tuesday!

    Palo Alto is on! 12/11 is w/, 12/12 hear from +more for $50!
    1 reply 5 retweets 9 likes
    Undo
  20. Retweeted
    8 Dec 2017

    At today in presenting our work with on managing with and

    1 reply 8 retweets 8 likes
    Show this thread
    Show this thread
    Undo

@ApacheParquet hasn't Tweeted yet.

Loading seems to be taking a while.

Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.

    You may also like

    ·