Skip to main content

How to Export Data Using Time Partitioning - Splitting Data for Each Period

Romain Ferraton
Romain Ferraton, ARPE.IO CEO
2026-03-08 · 8 min · Tutorial · FastBCP

FastBCP allows you to export data from databases using time-based partitioning. This tutorial demonstrates how to use it and thus split data into separate files for each period, making it easier to manage and analyze time-series data.

Supported Source Databases by FastBCP:

  • SQL Server
  • Oracle
  • PostgreSQL
  • MySQL
  • SAP HANA
  • Netezza
  • and more...

Target formats include:

  • Parquet
  • CSV
  • JSON
  • XLSX
  • BSON
  • PostgreSQL Binary

Final Storage can be on:

  • local disk
  • network share
  • Azure Blob Storage (ABS and ADLS Gen2)
  • Amazon S3
  • S3-Compatible
  • Google Cloud Storage
  • Onelake.

For the demonstration, we will use SQL Server and Oracle, but the same principles apply to all databases supported by FastBCP.

Why Use Time-Based Partitioning for Data Export?

Time-based partitioning is a powerful technique for managing and analyzing time-series data. By splitting data into separate files for each period. You can manage and analyze large datasets, improve query performance, with tools that can pushdown where predicate to avoid files scanning. Tools like DuckDB, Spark, Trino, Polars and more can take advantage of partitioning to speed up queries but also Big Query, Snowflake, Databricks, MotherDuck or MS Fabric.

How to Use FastBCP for Time-Based Partitioning

To export data using time-based partitioning with FastBCP, you can use the --parallelmethod timepartition option. This option allows you to specify a date\time column with --distributekeycolumn (datetimecolumn, <partitionpattern>) and a partitioning strategy to split the data into separate files for each period.

the partition pattern can be one of the following:

  • year: partitions data by year
  • year,month: partitions data by month
  • year,month,day: partitions data by day
  • year,week: partitions data by week

Example 1: Exporting Data with Time-Based Partitioning from SQL Server to parquet local files.

You can use the FastBCP command-line wizard to generate the command for you, or you can write it yourself.

Here is an example of how to export data from a SQL Server database using time-based partitioning by month:

.\FastBCP.exe `
--connectiontype "mssql" `
--server "MSI" `
--trusted `
--database "tpch_copy" `
--sourceschema "tpch_10" `
--sourcetable "orders_ds" `
--fileoutput "{sourcetable}.parquet" `
--directory "D:\outdata\timepartition\{sourceschema}\{sourcetable}\" `
--parallelmethod "Timepartition" `
--distributekeycolumn "(o_orderdate,year,month)" `
--merge false `
--runid "timepartition-demo"

FastBCP Logs for SQL Server to Parquet with Time Partitioning Example

The result with a 15 Million rows tpch orders will be 80 files, one for each month. Let's look at the log output of FastBCP to see how it works. Move to the directory where FastBCP is located and run the command, you should see output similar to the following in the console:

╔══════════════════════════════════════════════════════════════════════════╗
║ ║
║ ███████ █████ ███████ ████████ ███████ ███████ ███████ ║
║ ██ ██ ██ ██ ██ ██ ██ ██ ██ ██ ║
║ █████ ███████ ███████ ██ ███████ ██ ███████ ║
║ ██ ██ ██ ██ ██ ██ ██ ██ ██ ║
║ ██ ██ ██ ███████ ██ ███████ ███████ ██ ║
║ ║
║ High-Performance Parallel Bulk Data Export Tool ║
║ ║
╠══════════════════════════════════════════════════════════════════════════╣
║ Version: 0.30.1.0 License: Commercial ║
╠══════════════════════════════════════════════════════════════════════════╣
║ ║
║ - Data Sources: 12 - Formats: 6 - Targets: 6 ║
║ ║
╠══════════════════════════════════════════════════════════════════════════╣
║ Data Sources ║
║ • SQL Server • PostgreSQL • MySQL • Oracle ║
║ • Netezza • ClickHouse • SAP HANA • Teradata ║
║ • ODBC • OleDB • and more... ║
║ ║
║ Output Formats ║
║ • CSV • TSV • JSON • BSON ║
║ • Parquet • Excel (XLSX) ║
║ ║
║ Storage Targets ║
║ • Local Filesystem • AWS S3 ║
║ • S3-Compatible (MinIO, etc.) • Azure Blob Storage ║
║ • Azure Data Lake Gen2 • Microsoft Fabric OneLake ║
║ ║
╚══════════════════════════════════════════════════════════════════════════╝

Settings file not found in the working directory nor in the executable directory
2026-03-08T23:43:19.698 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- The "FastBCP_Settings.json" file does not exist. Using default settings. Console Only with loglevel=Information
2026-03-08T23:43:19.723 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- FastBCP Trial – will expires on "2026‑04‑03" (25 day(s) left).
2026-03-08T23:43:19.729 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Starting
2026-03-08T23:43:19.735 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- FastBCP Version : "0.30.1.0" Architecture : "X64" - Framework : ".NET 8.0.23"
2026-03-08T23:43:19.741 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Internal Trace ID : "d5e63fe5-f395-4931-9a10-cb87ee71babb"
2026-03-08T23:43:19.753 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Internal Run ID : "timepartition-demo"
2026-03-08T23:43:19.778 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- OS : "Microsoft Windows 10.0.26200"
2026-03-08T23:43:19.790 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Connection Type : "mssql"
2026-03-08T23:43:19.808 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Source SqlInstance : "MSI"
2026-03-08T23:43:19.822 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Source Database : "tpch_copy"
2026-03-08T23:43:19.826 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Source Schema : "tpch_10"
2026-03-08T23:43:19.829 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Source Table : "orders_ds"
2026-03-08T23:43:19.846 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Trusted Connection : True
2026-03-08T23:43:19.849 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Output File : "orders_ds.parquet"
2026-03-08T23:43:19.861 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Output Directory : D:\outdata\timepartition\{sourceschema}\{sourcetable}\
2026-03-08T23:43:19.894 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Degree : -2
2026-03-08T23:43:19.906 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Distribute Method : "Timepartition"
2026-03-08T23:43:19.909 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Distribute Column : "(o_orderdate,year,month)"
2026-03-08T23:43:19.934 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Decimal Separator : ","
2026-03-08T23:43:19.942 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Delimiter : "|"
2026-03-08T23:43:19.951 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Use quotes : False
2026-03-08T23:43:19.960 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Date format: "yyyy-MM-dd"
2026-03-08T23:43:19.963 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Encoding : "UTF-8"
2026-03-08T23:43:19.972 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- No Header : False
2026-03-08T23:43:19.976 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Timestamped : False
2026-03-08T23:43:19.991 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Boolean Format : "automatic"
2026-03-08T23:43:20.030 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Cloud Profile : ""
2026-03-08T23:43:20.059 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Run ID : "timepartition-demo"
2026-03-08T23:43:20.063 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Application Intent : "ReadOnly"
2026-03-08T23:43:20.082 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- file extension is ".parquet"
2026-03-08T23:43:20.087 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Encoding used : Unicode (UTF-8) - 65001 - utf-8
2026-03-08T23:43:20.116 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Connection String : "Data Source=MSI;Initial Catalog=tpch_copy;Integrated Security=True;Connect Timeout=120;Encrypt=True;Trust Server Certificate=True;Application Name=FastBCP;Application Intent=ReadOnly"
2026-03-08T23:43:20.274 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Source Database Version : Microsoft SQL Server 2022 (RTM-CU22-GDR) (KB5072936) - 16.0.4230.2 (X64) Nov 25 2025 23:31:11 Copyright (C) 2022 Microsoft Corporation Developer Edition (64-bit) on Windows 10 Pro 10.0 <X64> (Build 26200: ) (Hypervisor)
2026-03-08T23:43:20.300 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Get DataTypes with header end : Elapsed=5 ms
2026-03-08T23:43:20.306 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Degree of parallelism was computed to 16 (=> 32\2)
2026-03-08T23:43:20.801 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- TimePartition: 80 partitions discovered in 488 ms
2026-03-08T23:43:22.680 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1992/month=2" into D:\outdata\timepartition\tpch_10\orders_ds\year=1992\month=02\orders_ds.parquet | Completed: 180901 rows x 9 cols in 1870ms
2026-03-08T23:43:23.167 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1998/month=6" into D:\outdata\timepartition\tpch_10\orders_ds\year=1998\month=06\orders_ds.parquet | Completed: 186120 rows x 9 cols in 2354ms
2026-03-08T23:43:23.172 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1998/month=4" into D:\outdata\timepartition\tpch_10\orders_ds\year=1998\month=04\orders_ds.parquet | Completed: 186753 rows x 9 cols in 2360ms
2026-03-08T23:43:23.226 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1997/month=5" into D:\outdata\timepartition\tpch_10\orders_ds\year=1997\month=05\orders_ds.parquet | Completed: 193342 rows x 9 cols in 2414ms
2026-03-08T23:43:23.266 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1996/month=7" into D:\outdata\timepartition\tpch_10\orders_ds\year=1996\month=07\orders_ds.parquet | Completed: 193931 rows x 9 cols in 2453ms
2026-03-08T23:43:23.274 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1994/month=8" into D:\outdata\timepartition\tpch_10\orders_ds\year=1994\month=08\orders_ds.parquet | Completed: 193227 rows x 9 cols in 2462ms
2026-03-08T23:43:23.282 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1993/month=5" into D:\outdata\timepartition\tpch_10\orders_ds\year=1993\month=05\orders_ds.parquet | Completed: 193487 rows x 9 cols in 2471ms
2026-03-08T23:43:23.283 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1996/month=3" into D:\outdata\timepartition\tpch_10\orders_ds\year=1996\month=03\orders_ds.parquet | Completed: 193653 rows x 9 cols in 2472ms
2026-03-08T23:43:23.287 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1995/month=1" into D:\outdata\timepartition\tpch_10\orders_ds\year=1995\month=01\orders_ds.parquet | Completed: 193902 rows x 9 cols in 2475ms
2026-03-08T23:43:23.287 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1997/month=11" into D:\outdata\timepartition\tpch_10\orders_ds\year=1997\month=11\orders_ds.parquet | Completed: 186487 rows x 9 cols in 2476ms
2026-03-08T23:43:23.297 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1997/month=10" into D:\outdata\timepartition\tpch_10\orders_ds\year=1997\month=10\orders_ds.parquet | Completed: 193022 rows x 9 cols in 2484ms
2026-03-08T23:43:23.300 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1994/month=4" into D:\outdata\timepartition\tpch_10\orders_ds\year=1994\month=04\orders_ds.parquet | Completed: 187318 rows x 9 cols in 2489ms
2026-03-08T23:43:23.303 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1992/month=7" into D:\outdata\timepartition\tpch_10\orders_ds\year=1992\month=07\orders_ds.parquet | Completed: 193395 rows x 9 cols in 2493ms
2026-03-08T23:43:23.305 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1996/month=2" into D:\outdata\timepartition\tpch_10\orders_ds\year=1996\month=02\orders_ds.parquet | Completed: 180548 rows x 9 cols in 2492ms
2026-03-08T23:43:23.307 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1994/month=6" into D:\outdata\timepartition\tpch_10\orders_ds\year=1994\month=06\orders_ds.parquet | Completed: 187841 rows x 9 cols in 2496ms
2026-03-08T23:43:23.312 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1995/month=12" into D:\outdata\timepartition\tpch_10\orders_ds\year=1995\month=12\orders_ds.parquet | Completed: 193207 rows x 9 cols in 2501ms
2026-03-08T23:43:23.373 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1998/month=8" into D:\outdata\timepartition\tpch_10\orders_ds\year=1998\month=08\orders_ds.parquet | Completed: 12466 rows x 9 cols in 66ms
2026-03-08T23:43:23.660 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1992/month=10" into D:\outdata\timepartition\tpch_10\orders_ds\year=1992\month=10\orders_ds.parquet | Completed: 193312 rows x 9 cols in 974ms
2026-03-08T23:43:24.103 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1993/month=2" into D:\outdata\timepartition\tpch_10\orders_ds\year=1993\month=02\orders_ds.parquet | Completed: 175275 rows x 9 cols in 809ms
2026-03-08T23:43:24.109 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1995/month=6" into D:\outdata\timepartition\tpch_10\orders_ds\year=1995\month=06\orders_ds.parquet | Completed: 186946 rows x 9 cols in 878ms
2026-03-08T23:43:24.133 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1997/month=2" into D:\outdata\timepartition\tpch_10\orders_ds\year=1997\month=02\orders_ds.parquet | Completed: 174604 rows x 9 cols in 835ms
2026-03-08T23:43:24.135 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1997/month=3" into D:\outdata\timepartition\tpch_10\orders_ds\year=1997\month=03\orders_ds.parquet | Completed: 193173 rows x 9 cols in 956ms
2026-03-08T23:43:24.181 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1998/month=1" into D:\outdata\timepartition\tpch_10\orders_ds\year=1998\month=01\orders_ds.parquet | Completed: 193016 rows x 9 cols in 1008ms
2026-03-08T23:43:24.405 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1993/month=11" into D:\outdata\timepartition\tpch_10\orders_ds\year=1993\month=11\orders_ds.parquet | Completed: 187286 rows x 9 cols in 1087ms
2026-03-08T23:43:24.406 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1994/month=11" into D:\outdata\timepartition\tpch_10\orders_ds\year=1994\month=11\orders_ds.parquet | Completed: 187834 rows x 9 cols in 1136ms
2026-03-08T23:43:24.444 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1992/month=12" into D:\outdata\timepartition\tpch_10\orders_ds\year=1992\month=12\orders_ds.parquet | Completed: 193728 rows x 9 cols in 1166ms
2026-03-08T23:43:24.460 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1995/month=4" into D:\outdata\timepartition\tpch_10\orders_ds\year=1995\month=04\orders_ds.parquet | Completed: 187016 rows x 9 cols in 1138ms
2026-03-08T23:43:24.494 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1995/month=9" into D:\outdata\timepartition\tpch_10\orders_ds\year=1995\month=09\orders_ds.parquet | Completed: 187281 rows x 9 cols in 1207ms
2026-03-08T23:43:24.494 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1993/month=6" into D:\outdata\timepartition\tpch_10\orders_ds\year=1993\month=06\orders_ds.parquet | Completed: 187173 rows x 9 cols in 1117ms
2026-03-08T23:43:24.508 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1992/month=11" into D:\outdata\timepartition\tpch_10\orders_ds\year=1992\month=11\orders_ds.parquet | Completed: 187370 rows x 9 cols in 1197ms
2026-03-08T23:43:24.517 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1996/month=12" into D:\outdata\timepartition\tpch_10\orders_ds\year=1996\month=12\orders_ds.parquet | Completed: 193710 rows x 9 cols in 1215ms
2026-03-08T23:43:24.532 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1996/month=5" into D:\outdata\timepartition\tpch_10\orders_ds\year=1996\month=05\orders_ds.parquet | Completed: 193581 rows x 9 cols in 1242ms
2026-03-08T23:43:24.556 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1993/month=7" into D:\outdata\timepartition\tpch_10\orders_ds\year=1993\month=07\orders_ds.parquet | Completed: 192884 rows x 9 cols in 1243ms
2026-03-08T23:43:24.793 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1993/month=12" into D:\outdata\timepartition\tpch_10\orders_ds\year=1993\month=12\orders_ds.parquet | Completed: 193023 rows x 9 cols in 1130ms
2026-03-08T23:43:25.245 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1994/month=2" into D:\outdata\timepartition\tpch_10\orders_ds\year=1994\month=02\orders_ds.parquet | Completed: 174180 rows x 9 cols in 812ms
2026-03-08T23:43:25.248 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1996/month=11" into D:\outdata\timepartition\tpch_10\orders_ds\year=1996\month=11\orders_ds.parquet | Completed: 186851 rows x 9 cols in 1111ms
2026-03-08T23:43:25.275 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1998/month=5" into D:\outdata\timepartition\tpch_10\orders_ds\year=1998\month=05\orders_ds.parquet | Completed: 193587 rows x 9 cols in 1167ms
2026-03-08T23:43:25.297 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1997/month=12" into D:\outdata\timepartition\tpch_10\orders_ds\year=1997\month=12\orders_ds.parquet | Completed: 192893 rows x 9 cols in 1182ms
2026-03-08T23:43:25.305 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1997/month=4" into D:\outdata\timepartition\tpch_10\orders_ds\year=1997\month=04\orders_ds.parquet | Completed: 187126 rows x 9 cols in 1165ms
2026-03-08T23:43:25.312 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1996/month=4" into D:\outdata\timepartition\tpch_10\orders_ds\year=1996\month=04\orders_ds.parquet | Completed: 186910 rows x 9 cols in 876ms
2026-03-08T23:43:25.316 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1992/month=4" into D:\outdata\timepartition\tpch_10\orders_ds\year=1992\month=04\orders_ds.parquet | Completed: 187071 rows x 9 cols in 1129ms
2026-03-08T23:43:25.335 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1997/month=9" into D:\outdata\timepartition\tpch_10\orders_ds\year=1997\month=09\orders_ds.parquet | Completed: 186877 rows x 9 cols in 865ms
2026-03-08T23:43:25.365 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1996/month=9" into D:\outdata\timepartition\tpch_10\orders_ds\year=1996\month=09\orders_ds.parquet | Completed: 186615 rows x 9 cols in 867ms
2026-03-08T23:43:25.439 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1995/month=2" into D:\outdata\timepartition\tpch_10\orders_ds\year=1995\month=02\orders_ds.parquet | Completed: 173991 rows x 9 cols in 903ms
2026-03-08T23:43:25.458 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1993/month=8" into D:\outdata\timepartition\tpch_10\orders_ds\year=1993\month=08\orders_ds.parquet | Completed: 193634 rows x 9 cols in 958ms
2026-03-08T23:43:25.475 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1993/month=10" into D:\outdata\timepartition\tpch_10\orders_ds\year=1993\month=10\orders_ds.parquet | Completed: 192848 rows x 9 cols in 964ms
2026-03-08T23:43:25.479 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1998/month=3" into D:\outdata\timepartition\tpch_10\orders_ds\year=1998\month=03\orders_ds.parquet | Completed: 193144 rows x 9 cols in 958ms
2026-03-08T23:43:25.486 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1994/month=12" into D:\outdata\timepartition\tpch_10\orders_ds\year=1994\month=12\orders_ds.parquet | Completed: 193400 rows x 9 cols in 1012ms
2026-03-08T23:43:25.488 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1992/month=6" into D:\outdata\timepartition\tpch_10\orders_ds\year=1992\month=06\orders_ds.parquet | Completed: 186988 rows x 9 cols in 927ms
2026-03-08T23:43:25.652 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1998/month=2" into D:\outdata\timepartition\tpch_10\orders_ds\year=1998\month=02\orders_ds.parquet | Completed: 174605 rows x 9 cols in 854ms
2026-03-08T23:43:26.111 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1993/month=9" into D:\outdata\timepartition\tpch_10\orders_ds\year=1993\month=09\orders_ds.parquet | Completed: 187153 rows x 9 cols in 862ms
2026-03-08T23:43:26.254 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1995/month=7" into D:\outdata\timepartition\tpch_10\orders_ds\year=1995\month=07\orders_ds.parquet | Completed: 193607 rows x 9 cols in 1001ms
2026-03-08T23:43:26.269 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1995/month=5" into D:\outdata\timepartition\tpch_10\orders_ds\year=1995\month=05\orders_ds.parquet | Completed: 193116 rows x 9 cols in 990ms
2026-03-08T23:43:26.286 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1996/month=6" into D:\outdata\timepartition\tpch_10\orders_ds\year=1996\month=06\orders_ds.parquet | Completed: 186443 rows x 9 cols in 985ms
2026-03-08T23:43:26.296 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1997/month=6" into D:\outdata\timepartition\tpch_10\orders_ds\year=1997\month=06\orders_ds.parquet | Completed: 187241 rows x 9 cols in 976ms
2026-03-08T23:43:26.310 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1996/month=1" into D:\outdata\timepartition\tpch_10\orders_ds\year=1996\month=01\orders_ds.parquet | Completed: 192898 rows x 9 cols in 993ms
2026-03-08T23:43:26.312 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1994/month=7" into D:\outdata\timepartition\tpch_10\orders_ds\year=1994\month=07\orders_ds.parquet | Completed: 193213 rows x 9 cols in 972ms
2026-03-08T23:43:26.319 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1992/month=8" into D:\outdata\timepartition\tpch_10\orders_ds\year=1992\month=08\orders_ds.parquet | Completed: 193065 rows x 9 cols in 1009ms
2026-03-08T23:43:26.338 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1995/month=11" into D:\outdata\timepartition\tpch_10\orders_ds\year=1995\month=11\orders_ds.parquet | Completed: 186510 rows x 9 cols in 970ms
2026-03-08T23:43:26.393 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1994/month=10" into D:\outdata\timepartition\tpch_10\orders_ds\year=1994\month=10\orders_ds.parquet | Completed: 193143 rows x 9 cols in 949ms
2026-03-08T23:43:26.410 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1994/month=5" into D:\outdata\timepartition\tpch_10\orders_ds\year=1994\month=05\orders_ds.parquet | Completed: 192979 rows x 9 cols in 947ms
2026-03-08T23:43:26.425 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1994/month=9" into D:\outdata\timepartition\tpch_10\orders_ds\year=1994\month=09\orders_ds.parquet | Completed: 186790 rows x 9 cols in 935ms
2026-03-08T23:43:26.431 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1995/month=10" into D:\outdata\timepartition\tpch_10\orders_ds\year=1995\month=10\orders_ds.parquet | Completed: 193057 rows x 9 cols in 937ms
2026-03-08T23:43:26.431 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1994/month=3" into D:\outdata\timepartition\tpch_10\orders_ds\year=1994\month=03\orders_ds.parquet | Completed: 192773 rows x 9 cols in 952ms
2026-03-08T23:43:26.447 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1997/month=1" into D:\outdata\timepartition\tpch_10\orders_ds\year=1997\month=01\orders_ds.parquet | Completed: 193661 rows x 9 cols in 964ms
2026-03-08T23:43:26.577 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1993/month=3" into D:\outdata\timepartition\tpch_10\orders_ds\year=1993\month=03\orders_ds.parquet | Completed: 192790 rows x 9 cols in 921ms
2026-03-08T23:43:26.888 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1995/month=3" into D:\outdata\timepartition\tpch_10\orders_ds\year=1995\month=03\orders_ds.parquet | Completed: 193719 rows x 9 cols in 773ms
2026-03-08T23:43:27.112 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1995/month=8" into D:\outdata\timepartition\tpch_10\orders_ds\year=1995\month=08\orders_ds.parquet | Completed: 193223 rows x 9 cols in 794ms
2026-03-08T23:43:27.117 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1998/month=7" into D:\outdata\timepartition\tpch_10\orders_ds\year=1998\month=07\orders_ds.parquet | Completed: 193523 rows x 9 cols in 826ms
2026-03-08T23:43:27.128 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1996/month=8" into D:\outdata\timepartition\tpch_10\orders_ds\year=1996\month=08\orders_ds.parquet | Completed: 193921 rows x 9 cols in 855ms
2026-03-08T23:43:27.134 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1992/month=1" into D:\outdata\timepartition\tpch_10\orders_ds\year=1992\month=01\orders_ds.parquet | Completed: 193431 rows x 9 cols in 876ms
2026-03-08T23:43:27.135 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1997/month=8" into D:\outdata\timepartition\tpch_10\orders_ds\year=1997\month=08\orders_ds.parquet | Completed: 193801 rows x 9 cols in 821ms
2026-03-08T23:43:27.136 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1993/month=1" into D:\outdata\timepartition\tpch_10\orders_ds\year=1993\month=01\orders_ds.parquet | Completed: 194032 rows x 9 cols in 834ms
2026-03-08T23:43:27.152 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1994/month=1" into D:\outdata\timepartition\tpch_10\orders_ds\year=1994\month=01\orders_ds.parquet | Completed: 193221 rows x 9 cols in 828ms
2026-03-08T23:43:27.155 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1993/month=4" into D:\outdata\timepartition\tpch_10\orders_ds\year=1993\month=04\orders_ds.parquet | Completed: 187053 rows x 9 cols in 812ms
2026-03-08T23:43:27.196 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1992/month=3" into D:\outdata\timepartition\tpch_10\orders_ds\year=1992\month=03\orders_ds.parquet | Completed: 192413 rows x 9 cols in 744ms
2026-03-08T23:43:27.215 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1992/month=5" into D:\outdata\timepartition\tpch_10\orders_ds\year=1992\month=05\orders_ds.parquet | Completed: 192949 rows x 9 cols in 777ms
2026-03-08T23:43:27.219 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1997/month=7" into D:\outdata\timepartition\tpch_10\orders_ds\year=1997\month=07\orders_ds.parquet | Completed: 193284 rows x 9 cols in 785ms
2026-03-08T23:43:27.225 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1996/month=10" into D:\outdata\timepartition\tpch_10\orders_ds\year=1996\month=10\orders_ds.parquet | Completed: 192877 rows x 9 cols in 829ms
2026-03-08T23:43:27.257 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Load partition "year=1992/month=9" into D:\outdata\timepartition\tpch_10\orders_ds\year=1992\month=09\orders_ds.parquet | Completed: 186582 rows x 9 cols in 828ms
2026-03-08T23:43:27.265 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- files generation end : Elapsed=6959 ms - maxdop=16
2026-03-08T23:43:27.270 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Total data rows : 15000000
2026-03-08T23:43:27.273 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Total data columns : 9
2026-03-08T23:43:27.278 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Total cells : 135000000
2026-03-08T23:43:27.284 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Throughput rows : 1950805 rows/s
2026-03-08T23:43:27.288 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Throughput cells : 17557248 cells/s
2026-03-08T23:43:27.293 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Total time : Elapsed=7717 ms
2026-03-08T23:43:27.297 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Total data rows : 15000000
2026-03-08T23:43:27.301 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Total data columns : 9
2026-03-08T23:43:27.304 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Total cells : 135000000
2026-03-08T23:43:27.306 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Final Throughput rows : 1943697 rows/s
2026-03-08T23:43:27.309 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Final Throughput cells : 17493276 cells/s
2026-03-08T23:43:27.311 +01:00 -|- FastBCP -|- timepartition-demo -|- INFORMATION -|- orders_ds.parquet -|- Completed Load

Video tutorial : MSSQL to Parquet on local filesystem with time partitioning

In this video, we will demonstrate how to use FastBCP to export data using time partitioning, splitting data for each period. We will use the TPCH dataset as an example and show how to efficiently export data into partitioned Parquet files based on year and month.

Example 2: Exporting Data with Time-Based Partitioning from Oracle Database to parquet directly on AWS-S3.

In this example, we will demonstrate how to use FastBCP to export data from an Oracle database to Parquet files directly on AWS S3, using time-based partitioning. We will partition the data based on a date column, such as "o_orderdate", and export the data into separate Parquet files for each year and month.

AWS S3 (Or S3 compatible storage) authentication

With FastBCP you can configure AWS S3 authentication using

  • You **default aws cli profile **(so you need the AWS CLI to be installed)
  • An **aws cli named profile **(so you need the AWS CLI to be installed)
  • An IAM Role (if you are running FastBCP on an EC2 instance with an attached IAM role)
  • Environment variables : AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY, AWS_DEFAULT_REGION or AWS_SESSION_TOKEN
.\FastBCP.exe `
--connectiontype "oraodp" `
--server "localhost:1521/ORCLPDB" `
--user "$env:FAST_ORA_USER" `
--password "$env:FAST_ORA_PASSWORD" `
--database "ORCLPDB" `
--sourceschema "TPCH_IN" `
--sourcetable "ORDERS_FLAT" `
--fileoutput "orders.parquet" `
--directory "s3://aetpftoutput/timepartition/ora/{sourceschema}/{sourcetable}/" `
--parallelmethod "Timepartition" `
--distributekeycolumn "(o_orderdate,year,month)" `
--merge false `
--cloudprofile "aetp_ml"

This command will export the "ORDERS_FLAT" table from the "TPCH_IN" schema in the Oracle database to Parquet files on AWS S3, partitioned by year and month based on the "o_orderdate" column. The output files will be stored in the specified S3 directory, and FastBCP will handle the partitioning and exporting process efficiently.

If a file already exists for a given partition, FastBCP will overwrite it with the extrated data for that partition make it easy to keep the data up to date.

Video tutorial : Oracle to Parquet on AWS S3 with time partitioning

In this video, we will demonstrate how to use FastBCP to export data from an Oracle database to Parquet files directly on AWS S3, using time-based partitioning. We will show how to configure FastBCP for AWS S3 authentication and how to efficiently export data into partitioned Parquet files based on a date column.

FastBCP logs for Oracle to Parquet on AWS S3 with time partitioning example

╔══════════════════════════════════════════════════════════════════════════╗
║ ║
║ ███████ █████ ███████ ████████ ███████ ███████ ███████ ║
║ ██ ██ ██ ██ ██ ██ ██ ██ ██ ██ ║
║ █████ ███████ ███████ ██ ███████ ██ ███████ ║
║ ██ ██ ██ ██ ██ ██ ██ ██ ██ ║
║ ██ ██ ██ ███████ ██ ███████ ███████ ██ ║
║ ║
║ High-Performance Parallel Bulk Data Export Tool ║
║ ║
╠══════════════════════════════════════════════════════════════════════════╣
║ Version: 0.30.2.0 License: Commercial ║
╠══════════════════════════════════════════════════════════════════════════╣
║ ║
║ - Data Sources: 12 - Formats: 6 - Targets: 6 ║
║ ║
╠══════════════════════════════════════════════════════════════════════════╣
║ Data Sources ║
║ • SQL Server • PostgreSQL • MySQL • Oracle ║
║ • Netezza • ClickHouse • SAP HANA • Teradata ║
║ • ODBC • OleDB • and more... ║
║ ║
║ Output Formats ║
║ • CSV • TSV • JSON • BSON ║
║ • Parquet • Excel (XLSX) ║
║ ║
║ Storage Targets ║
║ • Local Filesystem • AWS S3 ║
║ • S3-Compatible (MinIO, etc.) • Azure Blob Storage ║
║ • Azure Data Lake Gen2 • Microsoft Fabric OneLake ║
║ ║
╚══════════════════════════════════════════════════════════════════════════╝

Settings file not found in the working directory nor in the executable directory
2026-03-10T23:49:53.905 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- The "FastBCP_Settings.json" file does not exist. Using default settings. Console Only with loglevel=Information
2026-03-10T23:49:53.922 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- FastBCP Trial – will expires on "2026‑04‑10" (30 day(s) left).
2026-03-10T23:49:53.925 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Starting
2026-03-10T23:49:53.928 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- FastBCP Version : "0.30.2.0" Architecture : "X64" - Framework : ".NET 8.0.23"
2026-03-10T23:49:53.931 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Internal Trace ID : "d2bfd384-581b-40c7-ae21-1f905c11d3a3"
2026-03-10T23:49:53.934 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Internal Run ID : "d2bfd384-581b-40c7-ae21-1f905c11d3a3"
2026-03-10T23:49:53.937 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- OS : "Microsoft Windows 10.0.26200"
2026-03-10T23:49:53.939 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Connection Type : "oraodp"
2026-03-10T23:49:53.942 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Source SqlInstance : "localhost:1521/ORCLPDB"
2026-03-10T23:49:53.945 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Source Database : "ORCLPDB"
2026-03-10T23:49:53.947 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Source Schema : "TPCH_IN"
2026-03-10T23:49:53.950 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Source Table : "ORDERS_FLAT"
2026-03-10T23:49:53.952 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Trusted Connection : False
2026-03-10T23:49:53.954 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- User : "TPCH_IN"
2026-03-10T23:49:53.959 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Output File : "orders.parquet"
2026-03-10T23:49:53.963 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Output Directory : s3://aetpftoutput/timepartition/ora/{sourceschema}/{sourcetable}/
2026-03-10T23:49:53.967 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Degree : -2
2026-03-10T23:49:53.971 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Distribute Method : "Timepartition"
2026-03-10T23:49:53.976 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Distribute Column : "(o_orderdate,year,month)"
2026-03-10T23:49:53.980 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Decimal Separator : ","
2026-03-10T23:49:53.984 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Delimiter : "|"
2026-03-10T23:49:53.986 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Use quotes : False
2026-03-10T23:49:53.991 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Date format: "yyyy-MM-dd"
2026-03-10T23:49:53.995 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Encoding : "UTF-8"
2026-03-10T23:49:54.021 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- No Header : False
2026-03-10T23:49:54.025 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Timestamped : False
2026-03-10T23:49:54.028 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Boolean Format : "automatic"
2026-03-10T23:49:54.033 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Cloud Profile : "aetp_ml"
2026-03-10T23:49:54.037 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Application Intent : "ReadOnly"
2026-03-10T23:49:54.055 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- file extension is ".parquet"
2026-03-10T23:49:54.058 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Using AWS Profile named "aetp_ml" for AWS Credentials
2026-03-10T23:49:54.937 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Encoding used : Unicode (UTF-8) - 65001 - utf-8
2026-03-10T23:49:54.965 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Connection String : "USER ID=TPCH_IN;PASSWORD=xxxxx;DATA SOURCE=localhost:1521/ORCLPDB;POOLING=False;CONNECTION TIMEOUT=120"
2026-03-10T23:49:58.320 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Source Database Version : Oracle Database 21c Enterprise Edition Release 21.0.0.0.0 - Production
2026-03-10T23:49:58.447 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Get DataTypes with header end : Elapsed=101 ms
2026-03-10T23:49:58.452 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Degree of parallelism was computed to 16 (=> 32\2)
2026-03-10T23:49:59.585 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- TimePartition: 80 partitions discovered in 1121 ms
2026-03-10T23:49:59.611 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1994/month=01/orders.parquet
2026-03-10T23:49:59.611 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1994/month=07/orders.parquet
2026-03-10T23:49:59.611 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1994/month=03/orders.parquet
2026-03-10T23:49:59.611 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1994/month=08/orders.parquet
2026-03-10T23:49:59.611 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1997/month=08/orders.parquet
2026-03-10T23:49:59.611 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1995/month=07/orders.parquet
2026-03-10T23:49:59.611 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1992/month=06/orders.parquet
2026-03-10T23:49:59.611 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1997/month=12/orders.parquet
2026-03-10T23:49:59.611 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1995/month=10/orders.parquet
2026-03-10T23:49:59.611 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1995/month=02/orders.parquet
2026-03-10T23:49:59.611 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1993/month=09/orders.parquet
2026-03-10T23:49:59.611 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1992/month=09/orders.parquet
2026-03-10T23:49:59.611 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1995/month=06/orders.parquet
2026-03-10T23:49:59.611 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1994/month=11/orders.parquet
2026-03-10T23:49:59.611 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1995/month=12/orders.parquet
2026-03-10T23:49:59.611 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1998/month=02/orders.parquet
2026-03-10T23:50:04.487 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1992/month=6" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1992/month=06/orders.parquet | Completed: 186988 rows x 9 cols in 4882ms
2026-03-10T23:50:04.508 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1995/month=09/orders.parquet
2026-03-10T23:50:04.538 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1995/month=2" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1995/month=02/orders.parquet | Completed: 173991 rows x 9 cols in 4931ms
2026-03-10T23:50:04.553 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1993/month=06/orders.parquet
2026-03-10T23:50:04.560 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1993/month=9" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1993/month=09/orders.parquet | Completed: 187153 rows x 9 cols in 4954ms
2026-03-10T23:50:04.585 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1998/month=03/orders.parquet
2026-03-10T23:50:04.706 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1998/month=2" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1998/month=02/orders.parquet | Completed: 174605 rows x 9 cols in 5101ms
2026-03-10T23:50:04.730 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1996/month=10/orders.parquet
2026-03-10T23:50:04.941 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1995/month=10" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1995/month=10/orders.parquet | Completed: 193057 rows x 9 cols in 5335ms
2026-03-10T23:50:04.950 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1994/month=1" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1994/month=01/orders.parquet | Completed: 193221 rows x 9 cols in 5344ms
2026-03-10T23:50:04.955 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1997/month=05/orders.parquet
2026-03-10T23:50:04.958 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1998/month=04/orders.parquet
2026-03-10T23:50:05.063 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1994/month=7" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1994/month=07/orders.parquet | Completed: 193213 rows x 9 cols in 5458ms
2026-03-10T23:50:05.077 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1992/month=10/orders.parquet
2026-03-10T23:50:05.087 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1997/month=12" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1997/month=12/orders.parquet | Completed: 192893 rows x 9 cols in 5481ms
2026-03-10T23:50:05.093 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1997/month=09/orders.parquet
2026-03-10T23:50:05.236 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1994/month=3" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1994/month=03/orders.parquet | Completed: 192773 rows x 9 cols in 5630ms
2026-03-10T23:50:05.409 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1992/month=9" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1992/month=09/orders.parquet | Completed: 186582 rows x 9 cols in 5802ms
2026-03-10T23:50:05.525 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1995/month=6" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1995/month=06/orders.parquet | Completed: 186946 rows x 9 cols in 5918ms
2026-03-10T23:50:05.615 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1992/month=11/orders.parquet
2026-03-10T23:50:05.618 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1996/month=11/orders.parquet
2026-03-10T23:50:05.621 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1996/month=02/orders.parquet
2026-03-10T23:50:05.636 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1995/month=7" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1995/month=07/orders.parquet | Completed: 193607 rows x 9 cols in 6031ms
2026-03-10T23:50:05.646 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1992/month=01/orders.parquet
2026-03-10T23:50:05.942 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1994/month=11" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1994/month=11/orders.parquet | Completed: 187834 rows x 9 cols in 6337ms
2026-03-10T23:50:06.250 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1997/month=01/orders.parquet
2026-03-10T23:50:06.724 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1997/month=8" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1997/month=08/orders.parquet | Completed: 193801 rows x 9 cols in 7118ms
2026-03-10T23:50:06.749 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1994/month=05/orders.parquet
2026-03-10T23:50:06.764 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1995/month=12" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1995/month=12/orders.parquet | Completed: 193207 rows x 9 cols in 7159ms
2026-03-10T23:50:06.791 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1996/month=09/orders.parquet
2026-03-10T23:50:06.893 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1994/month=8" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1994/month=08/orders.parquet | Completed: 193227 rows x 9 cols in 7287ms
2026-03-10T23:50:06.901 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1992/month=05/orders.parquet
2026-03-10T23:50:07.586 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1995/month=9" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1995/month=09/orders.parquet | Completed: 187281 rows x 9 cols in 3077ms
2026-03-10T23:50:07.592 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1994/month=04/orders.parquet
2026-03-10T23:50:07.792 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1996/month=10" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1996/month=10/orders.parquet | Completed: 192877 rows x 9 cols in 3062ms
2026-03-10T23:50:07.796 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1997/month=06/orders.parquet
2026-03-10T23:50:07.806 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1993/month=6" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1993/month=06/orders.parquet | Completed: 187173 rows x 9 cols in 3253ms
2026-03-10T23:50:07.812 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1997/month=11/orders.parquet
2026-03-10T23:50:07.903 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1997/month=9" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1997/month=09/orders.parquet | Completed: 186877 rows x 9 cols in 2810ms
2026-03-10T23:50:07.958 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1997/month=5" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1997/month=05/orders.parquet | Completed: 193342 rows x 9 cols in 3003ms
2026-03-10T23:50:07.996 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1997/month=04/orders.parquet
2026-03-10T23:50:08.001 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1994/month=06/orders.parquet
2026-03-10T23:50:08.264 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1998/month=3" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1998/month=03/orders.parquet | Completed: 193144 rows x 9 cols in 3679ms
2026-03-10T23:50:08.271 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1996/month=05/orders.parquet
2026-03-10T23:50:08.408 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1996/month=11" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1996/month=11/orders.parquet | Completed: 186851 rows x 9 cols in 2789ms
2026-03-10T23:50:08.614 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1992/month=04/orders.parquet
2026-03-10T23:50:08.702 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1996/month=2" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1996/month=02/orders.parquet | Completed: 180548 rows x 9 cols in 3080ms
2026-03-10T23:50:08.706 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1992/month=08/orders.parquet
2026-03-10T23:50:08.806 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1992/month=10" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1992/month=10/orders.parquet | Completed: 193312 rows x 9 cols in 3729ms
2026-03-10T23:50:08.812 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1997/month=1" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1997/month=01/orders.parquet | Completed: 193661 rows x 9 cols in 2562ms
2026-03-10T23:50:08.813 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1998/month=4" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1998/month=04/orders.parquet | Completed: 186753 rows x 9 cols in 3854ms
2026-03-10T23:50:08.877 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1997/month=03/orders.parquet
2026-03-10T23:50:08.881 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1993/month=03/orders.parquet
2026-03-10T23:50:08.885 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1996/month=08/orders.parquet
2026-03-10T23:50:08.944 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1992/month=11" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1992/month=11/orders.parquet | Completed: 187370 rows x 9 cols in 3329ms
2026-03-10T23:50:08.950 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1995/month=01/orders.parquet
2026-03-10T23:50:09.257 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1992/month=1" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1992/month=01/orders.parquet | Completed: 193431 rows x 9 cols in 3611ms
2026-03-10T23:50:09.435 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1994/month=5" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1994/month=05/orders.parquet | Completed: 192979 rows x 9 cols in 2685ms
2026-03-10T23:50:09.616 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1994/month=10/orders.parquet
2026-03-10T23:50:09.621 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1993/month=07/orders.parquet
2026-03-10T23:50:10.016 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1996/month=9" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1996/month=09/orders.parquet | Completed: 186615 rows x 9 cols in 3225ms
2026-03-10T23:50:10.037 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1994/month=4" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1994/month=04/orders.parquet | Completed: 187318 rows x 9 cols in 2445ms
2026-03-10T23:50:10.118 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1996/month=03/orders.parquet
2026-03-10T23:50:10.123 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1995/month=05/orders.parquet
2026-03-10T23:50:10.500 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1992/month=5" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1992/month=05/orders.parquet | Completed: 192949 rows x 9 cols in 3599ms
2026-03-10T23:50:10.504 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1992/month=12/orders.parquet
2026-03-10T23:50:10.919 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1997/month=6" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1997/month=06/orders.parquet | Completed: 187241 rows x 9 cols in 3122ms
2026-03-10T23:50:10.924 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1992/month=07/orders.parquet
2026-03-10T23:50:10.957 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1997/month=11" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1997/month=11/orders.parquet | Completed: 186487 rows x 9 cols in 3144ms
2026-03-10T23:50:10.961 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1994/month=02/orders.parquet
2026-03-10T23:50:11.004 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1997/month=4" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1997/month=04/orders.parquet | Completed: 187126 rows x 9 cols in 3008ms
2026-03-10T23:50:11.010 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1997/month=10/orders.parquet
2026-03-10T23:50:11.585 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1994/month=6" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1994/month=06/orders.parquet | Completed: 187841 rows x 9 cols in 3584ms
2026-03-10T23:50:11.589 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1993/month=10/orders.parquet
2026-03-10T23:50:11.813 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1996/month=5" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1996/month=05/orders.parquet | Completed: 193581 rows x 9 cols in 3541ms
2026-03-10T23:50:11.853 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1995/month=1" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1995/month=01/orders.parquet | Completed: 193902 rows x 9 cols in 2903ms
2026-03-10T23:50:11.871 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1992/month=8" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1992/month=08/orders.parquet | Completed: 193065 rows x 9 cols in 3165ms
2026-03-10T23:50:11.882 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1992/month=02/orders.parquet
2026-03-10T23:50:11.886 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1996/month=12/orders.parquet
2026-03-10T23:50:11.887 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1996/month=8" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1996/month=08/orders.parquet | Completed: 193921 rows x 9 cols in 3001ms
2026-03-10T23:50:11.891 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1996/month=04/orders.parquet
2026-03-10T23:50:11.936 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1992/month=4" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1992/month=04/orders.parquet | Completed: 187071 rows x 9 cols in 3322ms
2026-03-10T23:50:11.955 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1998/month=01/orders.parquet
2026-03-10T23:50:11.963 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1997/month=02/orders.parquet
2026-03-10T23:50:11.992 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1997/month=3" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1997/month=03/orders.parquet | Completed: 193173 rows x 9 cols in 3115ms
2026-03-10T23:50:12.025 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1996/month=06/orders.parquet
2026-03-10T23:50:12.193 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1993/month=3" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1993/month=03/orders.parquet | Completed: 192790 rows x 9 cols in 3312ms
2026-03-10T23:50:12.219 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1998/month=05/orders.parquet
2026-03-10T23:50:12.740 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1993/month=7" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1993/month=07/orders.parquet | Completed: 192884 rows x 9 cols in 3118ms
2026-03-10T23:50:12.745 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1993/month=05/orders.parquet
2026-03-10T23:50:12.842 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1994/month=10" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1994/month=10/orders.parquet | Completed: 193143 rows x 9 cols in 3225ms
2026-03-10T23:50:12.849 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1997/month=07/orders.parquet
2026-03-10T23:50:13.175 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1996/month=3" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1996/month=03/orders.parquet | Completed: 193653 rows x 9 cols in 3057ms
2026-03-10T23:50:13.274 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1992/month=12" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1992/month=12/orders.parquet | Completed: 193728 rows x 9 cols in 2770ms
2026-03-10T23:50:13.380 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1995/month=5" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1995/month=05/orders.parquet | Completed: 193116 rows x 9 cols in 3256ms
2026-03-10T23:50:13.416 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1993/month=02/orders.parquet
2026-03-10T23:50:13.420 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1995/month=08/orders.parquet
2026-03-10T23:50:13.425 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1993/month=08/orders.parquet
2026-03-10T23:50:13.611 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1992/month=7" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1992/month=07/orders.parquet | Completed: 193395 rows x 9 cols in 2687ms
2026-03-10T23:50:13.614 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1996/month=07/orders.parquet
2026-03-10T23:50:13.855 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1997/month=10" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1997/month=10/orders.parquet | Completed: 193022 rows x 9 cols in 2844ms
2026-03-10T23:50:13.916 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1994/month=2" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1994/month=02/orders.parquet | Completed: 174180 rows x 9 cols in 2955ms
2026-03-10T23:50:14.165 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1998/month=07/orders.parquet
2026-03-10T23:50:14.173 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1993/month=01/orders.parquet
2026-03-10T23:50:14.653 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1997/month=2" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1997/month=02/orders.parquet | Completed: 174604 rows x 9 cols in 2690ms
2026-03-10T23:50:14.724 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1992/month=2" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1992/month=02/orders.parquet | Completed: 180901 rows x 9 cols in 2841ms
2026-03-10T23:50:14.735 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1996/month=01/orders.parquet
2026-03-10T23:50:14.741 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1992/month=03/orders.parquet
2026-03-10T23:50:14.854 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1993/month=10" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1993/month=10/orders.parquet | Completed: 192848 rows x 9 cols in 3264ms
2026-03-10T23:50:14.863 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1995/month=03/orders.parquet
2026-03-10T23:50:15.005 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1998/month=1" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1998/month=01/orders.parquet | Completed: 193016 rows x 9 cols in 3049ms
2026-03-10T23:50:15.316 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1994/month=09/orders.parquet
2026-03-10T23:50:15.410 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1996/month=6" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1996/month=06/orders.parquet | Completed: 186443 rows x 9 cols in 3384ms
2026-03-10T23:50:15.415 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1995/month=04/orders.parquet
2026-03-10T23:50:15.536 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1996/month=4" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1996/month=04/orders.parquet | Completed: 186910 rows x 9 cols in 3644ms
2026-03-10T23:50:15.539 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1996/month=12" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1996/month=12/orders.parquet | Completed: 193710 rows x 9 cols in 3653ms
2026-03-10T23:50:15.572 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1998/month=06/orders.parquet
2026-03-10T23:50:15.577 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1995/month=11/orders.parquet
2026-03-10T23:50:15.605 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1998/month=5" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1998/month=05/orders.parquet | Completed: 193587 rows x 9 cols in 3385ms
2026-03-10T23:50:15.646 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1993/month=5" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1993/month=05/orders.parquet | Completed: 193487 rows x 9 cols in 2901ms
2026-03-10T23:50:15.778 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1993/month=11/orders.parquet
2026-03-10T23:50:15.782 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1993/month=04/orders.parquet
2026-03-10T23:50:16.397 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1997/month=7" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1997/month=07/orders.parquet | Completed: 193284 rows x 9 cols in 3548ms
2026-03-10T23:50:16.403 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1995/month=8" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1995/month=08/orders.parquet | Completed: 193223 rows x 9 cols in 2982ms
2026-03-10T23:50:16.480 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1993/month=2" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1993/month=02/orders.parquet | Completed: 175275 rows x 9 cols in 3064ms
2026-03-10T23:50:16.532 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1998/month=08/orders.parquet
2026-03-10T23:50:16.536 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1993/month=12/orders.parquet
2026-03-10T23:50:16.540 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1994/month=12/orders.parquet
2026-03-10T23:50:16.766 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1993/month=8" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1993/month=08/orders.parquet | Completed: 193634 rows x 9 cols in 3341ms
2026-03-10T23:50:16.971 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1996/month=7" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1996/month=07/orders.parquet | Completed: 193931 rows x 9 cols in 3356ms
2026-03-10T23:50:17.082 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1993/month=1" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1993/month=01/orders.parquet | Completed: 194032 rows x 9 cols in 2909ms
2026-03-10T23:50:17.429 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1998/month=7" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1998/month=07/orders.parquet | Completed: 193523 rows x 9 cols in 3264ms
2026-03-10T23:50:17.522 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1998/month=8" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1998/month=08/orders.parquet | Completed: 12466 rows x 9 cols in 990ms
2026-03-10T23:50:17.709 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1996/month=1" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1996/month=01/orders.parquet | Completed: 192898 rows x 9 cols in 2974ms
2026-03-10T23:50:17.931 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1995/month=3" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1995/month=03/orders.parquet | Completed: 193719 rows x 9 cols in 3067ms
2026-03-10T23:50:18.061 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1992/month=3" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1992/month=03/orders.parquet | Completed: 192413 rows x 9 cols in 3320ms
2026-03-10T23:50:18.170 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1995/month=4" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1995/month=04/orders.parquet | Completed: 187016 rows x 9 cols in 2754ms
2026-03-10T23:50:18.367 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1994/month=9" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1994/month=09/orders.parquet | Completed: 186790 rows x 9 cols in 3050ms
2026-03-10T23:50:18.592 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1993/month=4" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1993/month=04/orders.parquet | Completed: 187053 rows x 9 cols in 2809ms
2026-03-10T23:50:18.828 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1995/month=11" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1995/month=11/orders.parquet | Completed: 186510 rows x 9 cols in 3251ms
2026-03-10T23:50:18.894 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1998/month=6" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1998/month=06/orders.parquet | Completed: 186120 rows x 9 cols in 3322ms
2026-03-10T23:50:18.921 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1993/month=11" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1993/month=11/orders.parquet | Completed: 187286 rows x 9 cols in 3142ms
2026-03-10T23:50:18.959 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1994/month=12" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1994/month=12/orders.parquet | Completed: 193400 rows x 9 cols in 2419ms
2026-03-10T23:50:19.158 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Load partition "year=1993/month=12" into s3://aetpftoutput/timepartition/ora/TPCH_IN/ORDERS_FLAT/year=1993/month=12/orders.parquet | Completed: 193023 rows x 9 cols in 2622ms
2026-03-10T23:50:19.181 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- files generation end : Elapsed=20728 ms - maxdop=16
2026-03-10T23:50:19.189 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Total data rows : 15000000
2026-03-10T23:50:19.190 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Total data columns : 9
2026-03-10T23:50:19.192 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Total cells : 135000000
2026-03-10T23:50:19.194 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Throughput rows : 591347 rows/s
2026-03-10T23:50:19.195 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Throughput cells : 5322128 cells/s
2026-03-10T23:50:19.197 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Total time : Elapsed=25381 ms
2026-03-10T23:50:19.198 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Total data rows : 15000000
2026-03-10T23:50:19.204 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Total data columns : 9
2026-03-10T23:50:19.209 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Total cells : 135000000
2026-03-10T23:50:19.214 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Final Throughput rows : 590989 rows/s
2026-03-10T23:50:19.231 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Final Throughput cells : 5318909 cells/s
2026-03-10T23:50:19.236 +01:00 -|- FastBCP -|- d2bfd384-581b-40c7-ae21-1f905c11d3a3 -|- INFORMATION -|- orders.parquet -|- Completed Load

Performance are relatively correct if we take in account that i use my home network to send the data from my laptop to S3, but it can be improved by using a more powerful machine and a better network connection!

You can also add a query with a WHERE clause to filter the data for a specific time range, for example:

.\FastBCP.exe `
--connectiontype "oraodp" `
--server "localhost:1521/ORCLPDB" `
--user "$env:FAST_ORA_USER" `
--password "$env:FAST_ORA_PASSWORD" `
--database "ORCLPDB" `
--query "SELECT * FROM TPCH_IN.ORDERS_FLAT WHERE o_orderdate >= TO_DATE('1998-01-01', 'YYYY-MM-DD') AND o_orderdate < TO_DATE('1998-04-01', 'YYYY-MM-DD')" `
--fileoutput "orders.parquet" `
--directory "s3://aetpftoutput/timepartition/ora/{sourceschema}/{sourcetable}/" `
--parallelmethod "Timepartition" `
--distributekeycolumn "(o_orderdate,year,month)" `
--merge false `
--cloudprofile "aetp_ml"
╔══════════════════════════════════════════════════════════════════════════╗
║ ║
║ ███████ █████ ███████ ████████ ███████ ███████ ███████ ║
║ ██ ██ ██ ██ ██ ██ ██ ██ ██ ██ ║
║ █████ ███████ ███████ ██ ███████ ██ ███████ ║
║ ██ ██ ██ ██ ██ ██ ██ ██ ██ ║
║ ██ ██ ██ ███████ ██ ███████ ███████ ██ ║
║ ║
║ High-Performance Parallel Bulk Data Export Tool ║
║ ║
╠══════════════════════════════════════════════════════════════════════════╣
║ Version: 0.30.2.0 License: Commercial ║
╠══════════════════════════════════════════════════════════════════════════╣
║ ║
║ - Data Sources: 12 - Formats: 6 - Targets: 6 ║
║ ║
╠══════════════════════════════════════════════════════════════════════════╣
║ Data Sources ║
║ • SQL Server • PostgreSQL • MySQL • Oracle ║
║ • Netezza • ClickHouse • SAP HANA • Teradata ║
║ • ODBC • OleDB • and more... ║
║ ║
║ Output Formats ║
║ • CSV • TSV • JSON • BSON ║
║ • Parquet • Excel (XLSX) ║
║ ║
║ Storage Targets ║
║ • Local Filesystem • AWS S3 ║
║ • S3-Compatible (MinIO, etc.) • Azure Blob Storage ║
║ • Azure Data Lake Gen2 • Microsoft Fabric OneLake ║
║ ║
╚══════════════════════════════════════════════════════════════════════════╝

Settings file not found in the working directory nor in the executable directory
2026-03-10T23:58:48.337 +01:00 -|- FastBCP -|- 8545478b-b4cd-4e73-959f-e5ed7bc70f9d -|- INFORMATION -|- orders.parquet -|- The "FastBCP_Settings.json" file does not exist. Using default settings. Console Only with loglevel=Information
2026-03-10T23:58:48.442 +01:00 -|- FastBCP -|- 8545478b-b4cd-4e73-959f-e5ed7bc70f9d -|- INFORMATION -|- orders.parquet -|- FastBCP Trial – will expires on "2026‑04‑10" (30 day(s) left).
2026-03-10T23:58:48.449 +01:00 -|- FastBCP -|- 8545478b-b4cd-4e73-959f-e5ed7bc70f9d -|- INFORMATION -|- orders.parquet -|- Starting
2026-03-10T23:58:48.452 +01:00 -|- FastBCP -|- 8545478b-b4cd-4e73-959f-e5ed7bc70f9d -|- INFORMATION -|- orders.parquet -|- FastBCP Version : "0.30.2.0" Architecture : "X64" - Framework : ".NET 8.0.23"
2026-03-10T23:58:48.457 +01:00 -|- FastBCP -|- 8545478b-b4cd-4e73-959f-e5ed7bc70f9d -|- INFORMATION -|- orders.parquet -|- Internal Trace ID : "8545478b-b4cd-4e73-959f-e5ed7bc70f9d"
2026-03-10T23:58:48.463 +01:00 -|- FastBCP -|- 8545478b-b4cd-4e73-959f-e5ed7bc70f9d -|- INFORMATION -|- orders.parquet -|- Internal Run ID : "8545478b-b4cd-4e73-959f-e5ed7bc70f9d"
2026-03-10T23:58:48.466 +01:00 -|- FastBCP -|- 8545478b-b4cd-4e73-959f-e5ed7bc70f9d -|- INFORMATION -|- orders.parquet -|- OS : "Microsoft Windows 10.0.26200"
2026-03-10T23:58:48.471 +01:00 -|- FastBCP -|- 8545478b-b4cd-4e73-959f-e5ed7bc70f9d -|- INFORMATION -|- orders.parquet -|- Connection Type : "oraodp"
2026-03-10T23:58:48.476 +01:00 -|- FastBCP -|- 8545478b-b4cd-4e73-959f-e5ed7bc70f9d -|- INFORMATION -|- orders.parquet -|- Source SqlInstance : "localhost:1521/ORCLPDB"
2026-03-10T23:58:48.480 +01:00 -|- FastBCP -|- 8545478b-b4cd-4e73-959f-e5ed7bc70f9d -|- INFORMATION -|- orders.parquet -|- Source Database : "ORCLPDB"
2026-03-10T23:58:48.485 +01:00 -|- FastBCP -|- 8545478b-b4cd-4e73-959f-e5ed7bc70f9d -|- INFORMATION -|- orders.parquet -|- Trusted Connection : False
2026-03-10T23:58:48.490 +01:00 -|- FastBCP -|- 8545478b-b4cd-4e73-959f-e5ed7bc70f9d -|- INFORMATION -|- orders.parquet -|- User : "TPCH_IN"
2026-03-10T23:58:48.494 +01:00 -|- FastBCP -|- 8545478b-b4cd-4e73-959f-e5ed7bc70f9d -|- INFORMATION -|- orders.parquet -|- Output File : "orders.parquet"
2026-03-10T23:58:48.499 +01:00 -|- FastBCP -|- 8545478b-b4cd-4e73-959f-e5ed7bc70f9d -|- INFORMATION -|- orders.parquet -|- Output Directory : s3://aetpftoutput/timepartition/ora/{sourceschema}/{sourcetable}/
2026-03-10T23:58:48.503 +01:00 -|- FastBCP -|- 8545478b-b4cd-4e73-959f-e5ed7bc70f9d -|- INFORMATION -|- orders.parquet -|- Query : SELECT * FROM TPCH_IN.ORDERS_FLAT WHERE o_orderdate >= TO_DATE('1998-01-01', 'YYYY-MM-DD') AND o_orderdate < TO_DATE('1998-04-01', 'YYYY-MM-DD')
2026-03-10T23:58:48.506 +01:00 -|- FastBCP -|- 8545478b-b4cd-4e73-959f-e5ed7bc70f9d -|- INFORMATION -|- orders.parquet -|- Degree : -2
2026-03-10T23:58:48.509 +01:00 -|- FastBCP -|- 8545478b-b4cd-4e73-959f-e5ed7bc70f9d -|- INFORMATION -|- orders.parquet -|- Distribute Method : "Timepartition"
2026-03-10T23:58:48.513 +01:00 -|- FastBCP -|- 8545478b-b4cd-4e73-959f-e5ed7bc70f9d -|- INFORMATION -|- orders.parquet -|- Distribute Column : "(o_orderdate,year,month)"
2026-03-10T23:58:48.517 +01:00 -|- FastBCP -|- 8545478b-b4cd-4e73-959f-e5ed7bc70f9d -|- INFORMATION -|- orders.parquet -|- Decimal Separator : ","
2026-03-10T23:58:48.520 +01:00 -|- FastBCP -|- 8545478b-b4cd-4e73-959f-e5ed7bc70f9d -|- INFORMATION -|- orders.parquet -|- Delimiter : "|"
2026-03-10T23:58:48.523 +01:00 -|- FastBCP -|- 8545478b-b4cd-4e73-959f-e5ed7bc70f9d -|- INFORMATION -|- orders.parquet -|- Use quotes : False
2026-03-10T23:58:48.528 +01:00 -|- FastBCP -|- 8545478b-b4cd-4e73-959f-e5ed7bc70f9d -|- INFORMATION -|- orders.parquet -|- Date format: "yyyy-MM-dd"
2026-03-10T23:58:48.533 +01:00 -|- FastBCP -|- 8545478b-b4cd-4e73-959f-e5ed7bc70f9d -|- INFORMATION -|- orders.parquet -|- Encoding : "UTF-8"
2026-03-10T23:58:48.536 +01:00 -|- FastBCP -|- 8545478b-b4cd-4e73-959f-e5ed7bc70f9d -|- INFORMATION -|- orders.parquet -|- No Header : False
2026-03-10T23:58:48.540 +01:00 -|- FastBCP -|- 8545478b-b4cd-4e73-959f-e5ed7bc70f9d -|- INFORMATION -|- orders.parquet -|- Timestamped : False
2026-03-10T23:58:48.543 +01:00 -|- FastBCP -|- 8545478b-b4cd-4e73-959f-e5ed7bc70f9d -|- INFORMATION -|- orders.parquet -|- Boolean Format : "automatic"
2026-03-10T23:58:48.548 +01:00 -|- FastBCP -|- 8545478b-b4cd-4e73-959f-e5ed7bc70f9d -|- INFORMATION -|- orders.parquet -|- Cloud Profile : "aetp_ml"
2026-03-10T23:58:48.554 +01:00 -|- FastBCP -|- 8545478b-b4cd-4e73-959f-e5ed7bc70f9d -|- INFORMATION -|- orders.parquet -|- Application Intent : "ReadOnly"
2026-03-10T23:58:48.572 +01:00 -|- FastBCP -|- 8545478b-b4cd-4e73-959f-e5ed7bc70f9d -|- INFORMATION -|- orders.parquet -|- file extension is ".parquet"
2026-03-10T23:58:48.576 +01:00 -|- FastBCP -|- 8545478b-b4cd-4e73-959f-e5ed7bc70f9d -|- INFORMATION -|- orders.parquet -|- Using AWS Profile named "aetp_ml" for AWS Credentials
2026-03-10T23:58:49.443 +01:00 -|- FastBCP -|- 8545478b-b4cd-4e73-959f-e5ed7bc70f9d -|- INFORMATION -|- orders.parquet -|- Encoding used : Unicode (UTF-8) - 65001 - utf-8
2026-03-10T23:58:49.463 +01:00 -|- FastBCP -|- 8545478b-b4cd-4e73-959f-e5ed7bc70f9d -|- INFORMATION -|- orders.parquet -|- Connection String : "USER ID=TPCH_IN;PASSWORD=xxxxx;DATA SOURCE=localhost:1521/ORCLPDB;POOLING=False;CONNECTION TIMEOUT=120"
2026-03-10T23:58:52.941 +01:00 -|- FastBCP -|- 8545478b-b4cd-4e73-959f-e5ed7bc70f9d -|- INFORMATION -|- orders.parquet -|- Source Database Version : Oracle Database 21c Enterprise Edition Release 21.0.0.0.0 - Production
2026-03-10T23:58:53.458 +01:00 -|- FastBCP -|- 8545478b-b4cd-4e73-959f-e5ed7bc70f9d -|- INFORMATION -|- orders.parquet -|- Get DataTypes with header end : Elapsed=152 ms
2026-03-10T23:58:53.464 +01:00 -|- FastBCP -|- 8545478b-b4cd-4e73-959f-e5ed7bc70f9d -|- INFORMATION -|- orders.parquet -|- Degree of parallelism was computed to 16 (=> 32\2)
2026-03-10T23:58:53.995 +01:00 -|- FastBCP -|- 8545478b-b4cd-4e73-959f-e5ed7bc70f9d -|- INFORMATION -|- orders.parquet -|- TimePartition: 3 partitions discovered in 519 ms
2026-03-10T23:58:54.006 +01:00 -|- FastBCP -|- 8545478b-b4cd-4e73-959f-e5ed7bc70f9d -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/%7Bsourceschema%7D/%7Bsourcetable%7D/year=1998/month=02/orders.parquet
2026-03-10T23:58:54.006 +01:00 -|- FastBCP -|- 8545478b-b4cd-4e73-959f-e5ed7bc70f9d -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/%7Bsourceschema%7D/%7Bsourcetable%7D/year=1998/month=03/orders.parquet
2026-03-10T23:58:54.006 +01:00 -|- FastBCP -|- 8545478b-b4cd-4e73-959f-e5ed7bc70f9d -|- INFORMATION -|- orders.parquet -|- Prefix + TargetFullFileName = s3://aetpftoutput/timepartition/ora/%7Bsourceschema%7D/%7Bsourcetable%7D/year=1998/month=01/orders.parquet
2026-03-10T23:58:56.745 +01:00 -|- FastBCP -|- 8545478b-b4cd-4e73-959f-e5ed7bc70f9d -|- INFORMATION -|- orders.parquet -|- Load partition "year=1998/month=2" into s3://aetpftoutput/timepartition/ora/{sourceschema}/{sourcetable}/year=1998/month=02/orders.parquet | Completed: 174605 rows x 9 cols in 2743ms
2026-03-10T23:58:56.862 +01:00 -|- FastBCP -|- 8545478b-b4cd-4e73-959f-e5ed7bc70f9d -|- INFORMATION -|- orders.parquet -|- Load partition "year=1998/month=3" into s3://aetpftoutput/timepartition/ora/{sourceschema}/{sourcetable}/year=1998/month=03/orders.parquet | Completed: 193144 rows x 9 cols in 2860ms
2026-03-10T23:58:56.943 +01:00 -|- FastBCP -|- 8545478b-b4cd-4e73-959f-e5ed7bc70f9d -|- INFORMATION -|- orders.parquet -|- Load partition "year=1998/month=1" into s3://aetpftoutput/timepartition/ora/{sourceschema}/{sourcetable}/year=1998/month=01/orders.parquet | Completed: 193016 rows x 9 cols in 2941ms
2026-03-10T23:58:56.956 +01:00 -|- FastBCP -|- 8545478b-b4cd-4e73-959f-e5ed7bc70f9d -|- INFORMATION -|- orders.parquet -|- files generation end : Elapsed=3492 ms - maxdop=16
2026-03-10T23:58:56.964 +01:00 -|- FastBCP -|- 8545478b-b4cd-4e73-959f-e5ed7bc70f9d -|- INFORMATION -|- orders.parquet -|- Total data rows : 560765
2026-03-10T23:58:56.969 +01:00 -|- FastBCP -|- 8545478b-b4cd-4e73-959f-e5ed7bc70f9d -|- INFORMATION -|- orders.parquet -|- Total data columns : 9
2026-03-10T23:58:56.972 +01:00 -|- FastBCP -|- 8545478b-b4cd-4e73-959f-e5ed7bc70f9d -|- INFORMATION -|- orders.parquet -|- Total cells : 5046885
2026-03-10T23:58:56.974 +01:00 -|- FastBCP -|- 8545478b-b4cd-4e73-959f-e5ed7bc70f9d -|- INFORMATION -|- orders.parquet -|- Throughput rows : 61481 rows/s
2026-03-10T23:58:56.981 +01:00 -|- FastBCP -|- 8545478b-b4cd-4e73-959f-e5ed7bc70f9d -|- INFORMATION -|- orders.parquet -|- Throughput cells : 553332 cells/s
2026-03-10T23:58:56.985 +01:00 -|- FastBCP -|- 8545478b-b4cd-4e73-959f-e5ed7bc70f9d -|- INFORMATION -|- orders.parquet -|- Total time : Elapsed=9149 ms
2026-03-10T23:58:56.986 +01:00 -|- FastBCP -|- 8545478b-b4cd-4e73-959f-e5ed7bc70f9d -|- INFORMATION -|- orders.parquet -|- Total data rows : 560765
2026-03-10T23:58:56.988 +01:00 -|- FastBCP -|- 8545478b-b4cd-4e73-959f-e5ed7bc70f9d -|- INFORMATION -|- orders.parquet -|- Total data columns : 9
2026-03-10T23:58:56.990 +01:00 -|- FastBCP -|- 8545478b-b4cd-4e73-959f-e5ed7bc70f9d -|- INFORMATION -|- orders.parquet -|- Total cells : 5046885
2026-03-10T23:58:56.993 +01:00 -|- FastBCP -|- 8545478b-b4cd-4e73-959f-e5ed7bc70f9d -|- INFORMATION -|- orders.parquet -|- Final Throughput rows : 61290 rows/s
2026-03-10T23:58:56.996 +01:00 -|- FastBCP -|- 8545478b-b4cd-4e73-959f-e5ed7bc70f9d -|- INFORMATION -|- orders.parquet -|- Final Throughput cells : 551610 cells/s
2026-03-10T23:58:56.998 +01:00 -|- FastBCP -|- 8545478b-b4cd-4e73-959f-e5ed7bc70f9d -|- INFORMATION -|- orders.parquet -|- Completed Load

With FastBCP 0.30+, you can now easily export data using time partitioning, which allows you to split your data into multiple files based on a time column. This can be particularly useful for large datasets, as it can improve query performance and make it easier to manage your data.

Cloud Storage allowed by FastBCP are :

  • AWS S3
  • S3-Compatible (MinIO, etc.)
  • Azure Blob Storage
  • Azure Data Lake Gen2
  • Microsoft Fabric OneLake

Conclusion

In this tutorial, we have shown how to use FastBCP to export data in parallel using time partitioning, splitting data for each period.

By partitioning the data based on time, we can improve query performance on the extracted data and manage large datasets more efficiently. FastBCP provides a powerful and flexible way to handle data exports, making it easier to handle your data in SQL Server, Oracle, PostgreSQL, MySQL, SAP HANA and many more databases.

References