REGR: Barplot broken on Index(dtype='object') #38947

douglas-raillard-arm · 2021-01-04T16:15:25Z

Note: Please read this guide detailing how to provide the necessary information for us to reproduce your bug.

Code Sample, a copy-pastable example

df = pd.DataFrame(
    {
        'a': [1, 2],
    },
    index=pd.Index([0, 'Total'])
)
df.plot.bar()

Problem description

On pandas 1.2.0, this raises:

Traceback (most recent call last):
  File "/home/raillard/WFH/LISA/.lisa-venv-3.8/lib/python3.8/site-packages/pandas/core/indexes/base.py", line 706, in astype
    casted = self._values.astype(dtype, copy=copy)
ValueError: invalid literal for int() with base 10: 'Total'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "testplot.py", line 21, in <module>
    df.plot.bar()
  File "/home/raillard/WFH/LISA/.lisa-venv-3.8/lib/python3.8/site-packages/pandas/plotting/_core.py", line 1113, in bar
    return self(kind="bar", x=x, y=y, **kwargs)
  File "/home/raillard/WFH/LISA/.lisa-venv-3.8/lib/python3.8/site-packages/pandas/plotting/_core.py", line 955, in __call__
    return plot_backend.plot(data, kind=kind, **kwargs)
  File "/home/raillard/WFH/LISA/.lisa-venv-3.8/lib/python3.8/site-packages/pandas/plotting/_matplotlib/__init__.py", line 61, in plot
    plot_obj.generate()
  File "/home/raillard/WFH/LISA/.lisa-venv-3.8/lib/python3.8/site-packages/pandas/plotting/_matplotlib/core.py", line 280, in generate
    self._make_plot()
  File "/home/raillard/WFH/LISA/.lisa-venv-3.8/lib/python3.8/site-packages/pandas/plotting/_matplotlib/core.py", line 1434, in _make_plot
    self.tick_pos = ax.convert_xunits(self.ax_index).astype(np.int)
  File "/home/raillard/WFH/LISA/.lisa-venv-3.8/lib/python3.8/site-packages/pandas/core/indexes/base.py", line 708, in astype
    raise TypeError(
TypeError: Cannot cast Index to dtype int64

Expected Output

On pandas 1.1.5, it works without issues and produces a plot with 2 bars, one labeled "0" and the other one "Total" as expected.

Output of `pd.show_versions()`

Python 3.8.7 (default, Dec 24 2020, 17:53:09)
[GCC 10.2.0] on linux
Type "help", "copyright", "credits" or "license" for more information.

import pandas as pd
pd.show_versions()

INSTALLED VERSIONS

commit : 3e89b4c
python : 3.8.7.final.0
python-bits : 64
OS : Linux
OS-release : 5.10.3-arch1-1
Version : #1 SMP PREEMPT Sun, 27 Dec 2020 10:50:46 +0000
machine : x86_64
processor :
byteorder : little
LC_ALL : None
LANG : fr_FR.UTF-8
LOCALE : fr_FR.UTF-8

pandas : 1.2.0
numpy : 1.19.4
pytz : 2020.5
dateutil : 2.8.1
pip : 20.3.3
setuptools : 51.1.1
Cython : None
pytest : 6.2.1
hypothesis : None
sphinx : 3.4.2
blosc : None
feather : None
xlsxwriter : None
lxml.etree : None
html5lib : None
pymysql : None
psycopg2 : None
jinja2 : 2.11.2
IPython : 7.19.0
pandas_datareader: None
bs4 : None
bottleneck : None
fsspec : None
fastparquet : None
gcsfs : None
matplotlib : 3.3.3
numexpr : None
odfpy : None
openpyxl : None
pandas_gbq : None
pyarrow : 2.0.0
pyxlsb : None
s3fs : None
scipy : 1.6.0
sqlalchemy : None
tables : None
tabulate : None
xarray : None
xlrd : None
xlwt : None
numba : None

The text was updated successfully, but these errors were encountered:

pandas-dev/pandas#38947

mzeitlin11 · 2021-01-04T17:41:39Z

Thanks for the report @douglas-raillard-arm!

First bad commit fb379d8, (#28733)

xref #38736, #38865

arc12 · 2021-01-14T10:34:24Z

I suppose this identified bug also causes the following to fail with a TypeError: 'value' must be an instance of str or bytes, not a float

pd.Series(data=range(6), index=["A"] * 4 + [np.nan] * 2).plot(kind='bar')

This is fairly common kind of index arising from value_counts(dropna=False) in numerous places (for me)

simonjayhawkins · 2021-01-18T15:31:01Z

First bad commit fb379d8, (#28733)

#28733 has been reverted. needs tests to prevent regressions.

cckang · 2021-08-15T11:27:41Z

Test below code using pandas version ==> 1.4.0.dev0+424.gab5322ccd6

df = pd.DataFrame(
    {
        'a' : [1, 2],
    },
    index=pd.Index([0, 'Total'])
)

df.plot.bar()

I did not encounter any compilation errors when running the above code. However, it does not produce any plot.

sriakshata · 2021-08-20T06:55:57Z

With Pandas 1.3.1, it works fine. I think the problem is only with the 1.2.0 version of pandas. Apart from that is there any other problem? I might not have understood correctly, so please tell me if I am wrong. I am new to open source projects.

cckang · 2021-08-21T06:39:54Z

With Pandas 1.3.1, it works fine. I think the problem is only with the 1.2.0 version of pandas. Apart from that is there any other problem? I might not have understood correctly, so please tell me if I am wrong. I am new to open source projects.

i am new to open source also. Learning how to controubute :)

sriakshata · 2021-08-24T14:07:43Z

@douglas-raillard-arm , I am actually new to open source. My question is , it works fine with the pandas v1.3.2, I guess the problem is only with the pandas v1.2.0, since it works fine with the latest release, do we have to fix it in the pandas v1.2.0? Please guide me.

simonjayhawkins · 2021-08-24T14:20:31Z

no fixes required. the issue is to add a test to the pandas test suite to ensure we don't get a similar regression in the future.

SabrinaMB · 2021-09-23T21:51:37Z

please assign me to this issue

Daquisu · 2022-03-20T21:36:10Z

take

douglas-raillard-arm added Bug Needs Triage Issue that has not been reviewed by a pandas team member labels Jan 4, 2021

douglas-raillard-arm changed the title ~~BUG: Barplot broken on Index(dtype='object')~~ REGR: Barplot broken on Index(dtype='object') Jan 4, 2021

douglas-raillard-arm pushed a commit to ARM-software/lisa that referenced this issue Jan 4, 2021

setup.py: Avoid pandas 1.2.0 as it has broken barplots

2e61bd9

pandas-dev/pandas#38947

douglas-raillard-arm pushed a commit to ARM-software/lisa that referenced this issue Jan 4, 2021

setup.py: Avoid pandas 1.2.0 as it has broken barplots

3d54502

pandas-dev/pandas#38947

mzeitlin11 added Regression Functionality that used to work in a prior pandas version Visualization plotting and removed Bug Needs Triage Issue that has not been reviewed by a pandas team member labels Jan 4, 2021

jorisvandenbossche added this to the 1.2.1 milestone Jan 4, 2021

jorisvandenbossche mentioned this issue Jan 5, 2021

REGR: Bar plot from Series with IntervalIndex fails in pandas 1.2.0 #38969

Closed

3 tasks

simonjayhawkins mentioned this issue Jan 11, 2021

RLS: 1.2.1 #38721

Closed

phofl mentioned this issue Jan 12, 2021

BUG: df.plot.barh() broken from 1.1.5 to 1.2 under specific circumstances #39126

Closed

3 tasks

simonjayhawkins added the Needs Tests Unit test(s) needed to prevent regressions label Jan 18, 2021

simonjayhawkins modified the milestones: 1.2.1, Contributions Welcome Jan 18, 2021

mroeschke added the good first issue label Aug 14, 2021

SabrinaMB mentioned this issue Oct 14, 2021

REGR: Barplot broken on Index(dtype='object') #44033

Closed

4 tasks

github-actions bot assigned Daquisu Mar 20, 2022

Daquisu mentioned this issue Mar 20, 2022

TST: GH38947 creating function to test bar plot index #46451

Merged

4 tasks

mroeschke modified the milestones: Contributions Welcome, 1.5 Apr 24, 2022

mroeschke closed this as completed in #46451 Apr 24, 2022

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

REGR: Barplot broken on Index(dtype='object') #38947

REGR: Barplot broken on Index(dtype='object') #38947

douglas-raillard-arm commented Jan 4, 2021

INSTALLED VERSIONS

mzeitlin11 commented Jan 4, 2021

arc12 commented Jan 14, 2021

simonjayhawkins commented Jan 18, 2021

cckang commented Aug 15, 2021 •

edited

Loading

sriakshata commented Aug 20, 2021

cckang commented Aug 21, 2021

sriakshata commented Aug 24, 2021

simonjayhawkins commented Aug 24, 2021

SabrinaMB commented Sep 23, 2021

Daquisu commented Mar 20, 2022

REGR: Barplot broken on Index(dtype='object') #38947

REGR: Barplot broken on Index(dtype='object') #38947

Comments

douglas-raillard-arm commented Jan 4, 2021

Code Sample, a copy-pastable example

Problem description

Expected Output

Output of pd.show_versions()

INSTALLED VERSIONS

mzeitlin11 commented Jan 4, 2021

arc12 commented Jan 14, 2021

simonjayhawkins commented Jan 18, 2021

cckang commented Aug 15, 2021 • edited Loading

sriakshata commented Aug 20, 2021

cckang commented Aug 21, 2021

sriakshata commented Aug 24, 2021

simonjayhawkins commented Aug 24, 2021

SabrinaMB commented Sep 23, 2021

Daquisu commented Mar 20, 2022

Output of `pd.show_versions()`

cckang commented Aug 15, 2021 •

edited

Loading