Skip to content

Conversation

maiadegraaf
Copy link
Contributor

This PR introduces a new pragma custom_profiling_settings which accepts a path to a JSON file. The file can be used to turn on or off profiling settings when the profiling mode is set to JSON (PRAGMA enable_profiling = 'json';). If the pragma is not set, all profiling information will be included.

Currently, the settings are as follows:

  • CPU Timing: The total CPU time spent by that operator and its children.
  • Operator Cardinality: The number of rows returned by that operator
  • Operator Timing: The time spent by that operator
  • Extra Info: Any other information collected during the operation

An example of a custom profiling settings JSON file:

PRAGMA custom_profiling_settings='/path/to/settings.json'
{
  "cpu_time":"true",
  "operator_cardinality":"true",
}

The plan is to expand this feature to be able to include more settings in the future, as well as a new function in the C API that returns an object with the profiling information.

Mytherin and others added 20 commits March 9, 2024 10:54
…ions-to-spark-api

[Python]  Add some numeric and string functions to spark API
[ODBC] Allow multiple statements to be executed using SQLExecDirect
[CSV Reader] Apply projection on over buffer values.
Python: use short paths for Windows
Fix duckdb#10752: Add support for Parquet encryption on Windows
…-compliant

[Python] Code Quality - PEP8 Compliant + only relevant imports
[CI] Add patch argument to patch the extension's sources before building
fix(jdbc): support fractional seconds in getTime
Fix duckdb#11071 - correctly report progress when scanning multiple Parquet files
@github-actions github-actions bot marked this pull request as draft March 11, 2024 08:44
Mytherin and others added 4 commits March 11, 2024 10:12
# Conflicts:
#	src/include/duckdb/main/database_manager.hpp
#	src/main/database_manager.cpp
@maiadegraaf
Copy link
Contributor Author

Waiting for #11082 to be merged so CI passes

@maiadegraaf
Copy link
Contributor Author

Had to open a new PR due to some git problems -> #11101

@maiadegraaf maiadegraaf deleted the metrics branch June 3, 2024 12:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.