Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CLN: clean benchmarks to get them running #16025

Merged

Conversation

jorisvandenbossche
Copy link
Member

Changes to be compatible with latest master / py3.

@jorisvandenbossche jorisvandenbossche added this to the 0.20.0 milestone Apr 16, 2017
@jreback
Copy link
Contributor

jreback commented Apr 16, 2017

this is great

not sure if docs need any updates
i would default to 3.6 in the asv config as well

@jorisvandenbossche
Copy link
Member Author

Almost forgot, there was one remaining error related to hdf5:

[ 38.26%] ··· Running hdfstore_bench.HDF5.time_query_store_table_wide                                                                                                                           failed
[ 38.26%] ····· Traceback (most recent call last):
                  File "/home/joris/scipy/asv/asv/benchmark.py", line 794, in <module>
                    commands[mode](args)
                  File "/home/joris/scipy/asv/asv/benchmark.py", line 771, in main_run
                    result = benchmark.do_run()
                  File "/home/joris/scipy/asv/asv/benchmark.py", line 455, in do_run
                    return self.run(*self._current_params)
                  File "/home/joris/scipy/asv/asv/benchmark.py", line 547, in run
                    all_runs.extend(timer.repeat(repeat, number))
                  File "/home/joris/miniconda3/envs/dev/lib/python3.5/timeit.py", line 206, in repeat
                    t = self.timeit(number)
                  File "/home/joris/miniconda3/envs/dev/lib/python3.5/timeit.py", line 178, in timeit
                    timing = self.inner(it, self.timer)
                  File "<timeit-src>", line 6, in inner
                  File "/home/joris/scipy/pandas/asv_bench/benchmarks/hdfstore_bench.py", line 89, in time_query_store_table_wide
                    ('index', '<', self.df_wide2.index[15000])])
                  File "/home/joris/scipy/pandas/pandas/io/pytables.py", line 722, in select
                    return it.get_result()
                  File "/home/joris/scipy/pandas/pandas/io/pytables.py", line 1428, in get_result
                    results = self.func(self.start, self.stop, where)
                  File "/home/joris/scipy/pandas/pandas/io/pytables.py", line 715, in func
                    columns=columns, **kwargs)
                  File "/home/joris/scipy/pandas/pandas/io/pytables.py", line 4103, in read
                    if not self.read_axes(where=where, **kwargs):
                  File "/home/joris/scipy/pandas/pandas/io/pytables.py", line 3302, in read_axes
                    self.selection = Selection(self, where=where, **kwargs)
                  File "/home/joris/scipy/pandas/pandas/io/pytables.py", line 4664, in __init__
                    self.terms = self.generate(where)
                  File "/home/joris/scipy/pandas/pandas/io/pytables.py", line 4677, in generate
                    return Expr(where, queryables=q, encoding=self.table.encoding)
                  File "/home/joris/scipy/pandas/pandas/core/computation/pytables.py", line 532, in __init__
                    where = ' & ' .join(["(%s)" % w for w in where])  # noqa
                  File "/home/joris/scipy/pandas/pandas/core/computation/pytables.py", line 532, in <listcomp>
                    where = ' & ' .join(["(%s)" % w for w in where])  # noqa
                TypeError: not all arguments converted during string formatting

Benchmarks are here: https://github.com/pandas-dev/pandas/blob/master/asv_bench/benchmarks/hdfstore_bench.py#L87-L93
I am not very familiar with HDFStore, do you know what the issue is?

@jreback
Copy link
Contributor

jreback commented Apr 17, 2017

add a commit to use the correct syntax.

@jreback jreback added the Performance Memory or execution speed performance label Apr 17, 2017
@codecov
Copy link

codecov bot commented Apr 17, 2017

Codecov Report

Merging #16025 into master will decrease coverage by <.01%.
The diff coverage is n/a.

Impacted file tree graph

@@            Coverage Diff             @@
##           master   #16025      +/-   ##
==========================================
- Coverage   90.99%   90.99%   -0.01%     
==========================================
  Files         153      153              
  Lines       50470    50469       -1     
==========================================
- Hits        45927    45926       -1     
  Misses       4543     4543
Flag Coverage Δ
#multiple 88.76% <ø> (-0.01%) ⬇️
#single 40.43% <ø> (-0.01%) ⬇️
Impacted Files Coverage Δ
pandas/util/testing.py 80.73% <0%> (-0.02%) ⬇️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update f60b914...7e4b9dc. Read the comment docs.

@codecov
Copy link

codecov bot commented Apr 17, 2017

Codecov Report

Merging #16025 into master will decrease coverage by <.01%.
The diff coverage is n/a.

Impacted file tree graph

@@            Coverage Diff             @@
##           master   #16025      +/-   ##
==========================================
- Coverage   90.99%   90.99%   -0.01%     
==========================================
  Files         153      153              
  Lines       50470    50469       -1     
==========================================
- Hits        45927    45926       -1     
  Misses       4543     4543
Flag Coverage Δ
#multiple 88.76% <ø> (-0.01%) ⬇️
#single 40.43% <ø> (-0.01%) ⬇️
Impacted Files Coverage Δ
pandas/util/testing.py 80.73% <0%> (-0.02%) ⬇️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update f60b914...9a074cf. Read the comment docs.

@jorisvandenbossche
Copy link
Member Author

Thanks!

(BTW, you should link your two sigma address to your github account, it is not yet recognizing your commits)

@jorisvandenbossche
Copy link
Member Author

Changed to 3.6 as well!

@jorisvandenbossche jorisvandenbossche merged commit c6060a8 into pandas-dev:master Apr 17, 2017
@jreback
Copy link
Contributor

jreback commented Apr 17, 2017

(BTW, you should link your two sigma address to your github account, it is not yet recognizing your commits)

where do you see a problem?

side issue - I have a couple more small reorgs (indexes, tools) coming

@jorisvandenbossche
Copy link
Member Author

If you look at the commit you added in this PR, it doesn't have your icon, and if you look at the commit: 7e4b9dc, the question mark next to the author gives some more explanation

@jreback
Copy link
Contributor

jreback commented Apr 17, 2017

e-mail address fixed thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Clean Performance Memory or execution speed performance
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants