Skip to content

PERF: write basic datetimes faster #10271

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 1 commit into from
Jun 4, 2015
Merged

PERF: write basic datetimes faster #10271

merged 1 commit into from
Jun 4, 2015

Conversation

jreback
Copy link
Contributor

@jreback jreback commented Jun 4, 2015

with PR

In [2]: df = DataFrame({'A' : pd.date_range('20130101',periods=100000,freq='s')})

In [3]: %timeit df.to_csv('test.csv',mode='w')
1 loops, best of 3: 282 ms per loop

0.16.1

In [2]: %timeit df.to_csv('test.csv',mode='w')
1 loops, best of 3: 352 ms per loop

@jreback jreback added Performance Memory or execution speed performance Output-Formatting __repr__ of pandas objects, to_string IO CSV read_csv, to_csv labels Jun 4, 2015
@jreback jreback added this to the 0.16.2 milestone Jun 4, 2015
jreback added a commit that referenced this pull request Jun 4, 2015
@jreback
Merge pull request #10271 from jreback/dt-perf
93150ba 
PERF: write basic datetimes faster
@jreback jreback merged commit 93150ba into pandas-dev:master Jun 4, 2015
cgevans added a commit to cgevans/pandas that referenced this pull request Jun 5, 2015
@cgevans
Merge https://github.com/pydata/pandas into fastsplit
db330d4 
* https://github.com/pydata/pandas: (26 commits)
  disable some deps on 3.2 build
  Fix meantim typo
  DOC: use current ipython in doc build
  PERF: write basic datetimes faster pandas-dev#10271
  TST: fix for bottleneck >= 1.0 nansum behavior, xref pandas-dev#9422
  add numba example to enhancingperf.rst
  BUG: SparseSeries constructor ignores input data name
  BUG: Raise TypeError only if key DataFrame is not empty pandas-dev#10126
  ENH: groupby.apply for Categorical should preserve categories (closes pandas-dev#10138)
  DOC: add in whatsnew/0.17.0.txt
  DOC: move whatsnew from 0.17.0 -> 0.16.2
  BUG:  Holiday(..) with both offset and observance raises NotImplementedError pandas-dev#10217
  BUG: Index.union cannot handle array-likes
  BUG: SparseSeries.abs() resets name
  BUG: Series arithmetic methods incorrectly hold name
  ENH: Don't infer WOM-5MON if we don't support it (pandas-dev#9425)
  BUG: Series.align resets name when fill_value is specified
  BUG: GroupBy.get_group raises ValueError when group key contains NaT
  Close mysql connection in TestXMySQL to prevent tests freezing
  BUG: plot doesnt default to matplotlib axes.grid setting (pandas-dev#9792)
  ...
jreback added a commit that referenced this pull request Jun 5, 2015
@jreback
Revert "PERF: write basic datetimes faster #10271"
dc815bc 
This reverts commit 4698ffc.
yarikoptic added a commit to neurodebian/pandas that referenced this pull request Jul 2, 2015
@yarikoptic
Merge commit 'v0.16.1-97-gbc7d48f' into debian
9a51574 
* commit 'v0.16.1-97-gbc7d48f': (56 commits)
  disable some deps on 3.2 build
  Fix meantim typo
  DOC: use current ipython in doc build
  PERF: write basic datetimes faster pandas-dev#10271
  TST: fix for bottleneck >= 1.0 nansum behavior, xref pandas-dev#9422
  add numba example to enhancingperf.rst
  BUG: SparseSeries constructor ignores input data name
  BUG: Raise TypeError only if key DataFrame is not empty pandas-dev#10126
  ENH: groupby.apply for Categorical should preserve categories (closes pandas-dev#10138)
  DOC: add in whatsnew/0.17.0.txt
  DOC: move whatsnew from 0.17.0 -> 0.16.2
  BUG:  Holiday(..) with both offset and observance raises NotImplementedError pandas-dev#10217
  BUG: Index.union cannot handle array-likes
  BUG: SparseSeries.abs() resets name
  BUG: Series arithmetic methods incorrectly hold name
  ENH: Don't infer WOM-5MON if we don't support it (pandas-dev#9425)
  BUG: Series.align resets name when fill_value is specified
  BUG: GroupBy.get_group raises ValueError when group key contains NaT
  Close mysql connection in TestXMySQL to prevent tests freezing
  BUG: plot doesnt default to matplotlib axes.grid setting (pandas-dev#9792)
  ...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
IO CSV read_csv, to_csv Output-Formatting __repr__ of pandas objects, to_string Performance Memory or execution speed performance
Projects
None yet
Milestone
0.16.2
Development

Successfully merging this pull request may close these issues.
1 participant
@jreback