Hacker Newsnew | past | comments | ask | show | jobs | submitlogin
Bridging analytics and data science workflows with GPUs (omnisci.com)
19 points by tmostak on Aug 15, 2019 | hide | past | favorite | 11 comments


A few comments:

1. I'm usually down on dark-mode but this looks clean as hell 2. The JupyterHub integration looks nice! It was mentioned in the article it was the "tip of the iceberg" I'm wondering how hard it would be to integrate with a tool like Observable.

Observable: https://observablehq.com/


Thanks! We're big Observable fans, and you can find quite a few examples here: https://observablehq.com/search?query=mapd and https://observablehq.com/search?query=omnisci. But imagine we could do something deeper, any thoughts?


Mike Bostock's notebook here is a great starting point, showing how to import and use mapd-connector [1] in an Observable notebook and then feed its data into a vega-lite chart:

https://observablehq.com/@mbostock/hello-mapd-connector

[1]: The Javascript client for connecting to OmniSci, https://github.com/omnisci/mapd-connector


This is a good point. There are lots of interesting possibilities with Observable, especially using the OmniSciDB open-source project for analyses that people intentionally do want to share


It's certainly possible, I guess the bigger question is whether people would be comfortable having a database do an automatic data transfer into a public tool. In the case of this Jupyter integration, it's a Docker image that's running next to the OmniSci database, so it's all within the same network


The support for JupyterLab looks great and +1 for Dark Mode.


Thanks @jonbaer, and lot's more exciting stuff to come!


Dark Mode looks amazing. So clean.

I'm looking forward to exploring the integration with Jupyter.


Does it scale?


Check out this example crunching 1.45 billion rows on my 32GB Macbook Pro (CPU-only). https://twitter.com/ToddMostak/status/1162067442081751040?s=... With a GPU cluster it's very possible to handle 100+ billion rows with sub-second response times.


Could you be more specific? Does which part scale?




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: