Skip to content

Aggregate security logs with cudf and pandas for graphing - #114

Merged
lmeyerov merged 4 commits into
masterfrom
cudf-timed-groupbys
Apr 17, 2019
Merged

lmeyerov merged 4 commits into
masterfrom
cudf-timed-groupbys

Conversation

@lsb

@lsb lsb commented Apr 13, 2019 •

Copy link
Copy Markdown
Contributor

In demos/demos_databases_apis, adds /gpu_rapids/*:

part_i_cpu_pandas: load bro, analyze, plot
part_ii_gpu_rapids_cudf: load bro, analyze, plot

  • About 10-20X speedup on 5pct of data
  • On ~75% of data, cudf takes 5-10s, while pandas dies
  • Setup so we can later add cugraph, blazing, etc. as they start working

@lmeyerov

Copy link
Copy Markdown
Contributor

Guessing WIP

@lmeyerov
lmeyerov merged commit d87e1e6 into master Apr 17, 2019
@lmeyerov
lmeyerov deleted the cudf-timed-groupbys branch April 17, 2019 01:44
lmeyerov pushed a commit that referenced this pull request Mar 13, 2022
* Aggregate security logs with cudf and pandas for graphing

* docs(cudf demo): v0

* docs(cudf nb): turn into tutorial and update forward and back links

* fix(cudf nb): now works!
pull Bot referenced this pull request in admariner/pygraphistry Mar 13, 2022
* Aggregate security logs with cudf and pandas for graphing

* docs(cudf demo): v0

* docs(cudf nb): turn into tutorial and update forward and back links

* fix(cudf nb): now works!
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants