Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-44111 Prepare Apache Spark 4.0.0
  3. SPARK-47719

Change default of spark.sql.legacy.timeParserPolicy from EXCEPTION to CORRECTED

    XMLWordPrintableJSON

Details

    Description

      spark.sql.legacy.timeParserPolicy was introduced in Spark 3.0 and has been set to EXCEPTION.
      Changing it from EXCEPTION for SPark 4.0 to CORRECTED will reduce errors and reflects a prudent timeframe.

      Attachments

        Issue Links

          is duplicated by

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-47714 Set spark.sql.legacy.timeParserPolicy to CORRECTED by default

          • Major - Major loss of function.
          • Closed
          links to

          Web Link GitHub Pull Request #45859

          Activity

            People

              srielau Serge Rielau
              srielau Serge Rielau
              Max Gekk Max Gekk
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: