Convert timestamp ISO to datetime in Python?

pandas timestamp to datetime
convert timestamp to date python pandas
convert string to datetime python
strptime python
pandas to_datetime
python datetime
convert object to datetime python
python datetime to timestamp

I am trying to convert an ISO timestamp column in my dataset to datetime. I'm able to successfully convert certain rows but others fail without a noticeable pattern.

Here is what my raw data looks like:

911     2015-10-15T12:39:36
2520    2015-10-02T14:54:58
2545    2015-09-18T21:07:40
805     2015-10-28T17:17:22

I try to run this code on it:

datetime.strptime(orders['Timestamp'][58], "%Y-%m-%dT%H:%M:%S")

Sometimes it works and turns into datetime:

2015-05-16 08:46:10
2015-05-15 17:02:04
2015-05-15 16:43:42
2015-05-15 16:40:16

Every 50 rows or so it throws up an error:

KeyError                                  Traceback (most recent call last)
<ipython-input-130-2db5a7ab5914> in <module>()
      1 for i in range(116, len(orders['Timestamp'])):
----> 2     df_dt=datetime.strptime(orders['Timestamp'][i],"%Y-%m-%dT%H:%M:%S")
      3     print df_dt

c:\python27\lib\site-packages\pandas\core\series.pyc in __getitem__(self, key)
    549     def __getitem__(self, key):
    550         try:
--> 551             result = self.index.get_value(self, key)
    552 
    553             if not np.isscalar(result):

c:\python27\lib\site-packages\pandas\core\index.pyc in get_value(self, series, key)
   1721 
   1722         try:
-> 1723             return self._engine.get_value(s, k)
   1724         except KeyError as e1:
   1725             if len(self) > 0 and self.inferred_type in ['integer','boolean']:

pandas\index.pyx in pandas.index.IndexEngine.get_value (pandas\index.c:3204)()

pandas\index.pyx in pandas.index.IndexEngine.get_value (pandas\index.c:2903)()

pandas\index.pyx in pandas.index.IndexEngine.get_loc (pandas\index.c:3843)()

pandas\hashtable.pyx in pandas.hashtable.Int64HashTable.get_item (pandas\hashtable.c:6525)()

pandas\hashtable.pyx in pandas.hashtable.Int64HashTable.get_item (pandas\hashtable.c:6463)()

KeyError: 268L

Can't tell why the other dates are successfully converted but not these (can't see a pattern):

2015-05-30T22:25:52
2015-03-04T03:57:51
2013-11-22T22:28:23

Thanks.


You can use to_datetime:

In [11]: df
Out[11]:
      0                    1
0   911  2015-10-15T12:39:36
1  2520  2015-10-02T14:54:58
2  2545  2015-09-18T21:07:40
3   805  2015-10-28T17:17:22

In [12]: pd.to_datetime(df[1])
Out[12]:
0   2015-10-15 12:39:36
1   2015-10-02 14:54:58
2   2015-09-18 21:07:40
3   2015-10-28 17:17:22
Name: 1, dtype: datetime64[ns]

Converting Strings to datetime in Python, In this tutorial, we'll be converting Strings to datetime in Python, dealing with Python comes with the built-in module datetime for dealing with dates and times. If our input string to create a datetime object is in the same ISO 8601 format, we � Python timestamp to datetime and vice-versa In this article, you will learn to convert timestamp to datetime object and datetime object to timestamp (with the help of examples).


The error your script is throwing is KeyError, not ValueError (which would have been the case if your date format had any problems). Make sure that the key is there in the dicts by something like this before using them:

EDIT After having a second look into your error log, I realized that the KeyError isn't triggered in your script, but the core pandas module: c:\python27\lib\site-packages\pandas\core\index.pyc. So, as I explained in the comments, this is a pandas core issue. You may raise a bug on their issue tracker by mentioning these details.

datetime — Basic date and time types — Python 3.8.5 documentation, The datetime module supplies classes for manipulating dates and times. If no argument is a float, the conversion and normalization processes are Return a date corresponding to the ISO calendar date specified by year, week and day. There are multiple ways how you can convert timestamp to human readable form in Python. For this conversion you may either use module datetime or time. Using module datetime. Module datetime provides classes for manipulating date and time in more object oriented way.


If your ISO is in the proper format (not str), you can just:

from datetime import datetime

datetime.timestamp(timestamp_ISO_8601)

This will turn your timestamp to Epoch. From there, you can convert to anything you want. That's how I do it.

Parse "Z" timezone suffix in datetime - Ideas, The function datetime.fromisoformat() parses a datetime in ISO-8601, format: > The same goes for datetime.fromisocalendar and datetime.fromtimestamp . $ python3 datetime-tzinfo-4.py America/New_York: 2018-06-29 22:21:41.349491-04:00 Europe/London: 2018-06-30 03:21:41.349491+01:00 As expected, the date-times are different since they're about 5 hours apart. Using Third Party Libraries. Python's datetime module can convert all different types of strings to a datetime object.


How To Convert Timestamp To Date and Time in Python, For this conversion you may either use module datetime or time. readable = datetime.datetime.fromtimestamp(1596110867).isoformat() print(readable)� To use this we need to import datetime class from python’s datetime module i.e. from datetime import datetime Let’s use it to convert datetime object to string. Example 1: Get the current timestamp in a datetime object i.e. dateTimeObj = datetime.now() Convert this datetime object to string in format ‘DD-MMM-YYYY (HH:MM:SS:MICROS)’ i.e.


Python, isoformat() function is used to convert the given Timestamp object into the ISO format. Syntax :Timestamp.isoformat() Parameters : None. Return : date time as a string. I wanted to parse this date string at the skill endpoint and respond to the user accordingly. Since the endpoint was hosted as python funtion in AWS Lamda, I looked into my go to python reference, the docs page. If the date format is YYYY-MM-DD, Python’s datetime.datetime has some nifty helpers to convert the date string into a datetime object.


How to convert datetime to and from ISO 8601 string – Code Yarns , For example,… In "iso". Tagged; datetime � dateutil � iso 8601 � python� Python’s datetime module provides a datetime class, which has a method to convert string to a datetime object i.e. datetime.strptime(date_string, format) If accepts a string containing the timestamp and a format string containing the format codes representing the date time elements in date_string.