Navigation:
Browse pkgsrc
(this page)
databases duckdb
CVSweb ] [ 
Homepage ] [ 
RSS ] [ 
Required by ] [ 
Add to tracker ] 2025-06-15 15:30:20 by Ryo ONODERA | Files touched by this commit (6) |  |
Log message:
databases/duckdb: Update to 1.3.0
* Prepare for databases/py-duckdb.
Changelog:
1.3.0:
What's Changed
V1.2 histrionicus by @Mytherin in #16070
V1.2 histrionicus by @Mytherin in #16072
unittests: clear test directory after every test by @Mytherin in #16053
Benchmark runner: catch and log errors + add support for retry load N syntax \
by @Mytherin in #16054
Throw an error when unsupported commands are used in concurrentloop by \
@Mytherin in #16009
Remove extension definitions to prevent re-compilation of the entire system \
on commit by @Mytherin in #15955
Display schema information of currently selected database only by \
@ashwaniYDV in #15815
Issue #14366: Average Intervals by @hawkfish in #15864
Internal #2176: Temporal AVG by @hawkfish in #15661
discussions #15981: remove confusing comment in \
"duckdb/tools/shell/shell.cpp" by @komainu8 in #15984
Fix #15466 Transform LIMIT or OFFSET first based on order specified in \
prepared statement by @ashwaniYDV in #15484
Bitpacking mode info by @arjenpdevries in #15623
Sniff Timestamp_TZ from CSV FIles by @pdet in #15730
[no-op] Add documentation for filesystem read behavior by @dentiny in #15937
Accept "Auto" as date/timestamp format by @pdet in #15808
Parquet Reader Cleanup: Move ColumnReaders to separate files by @Mytherin in \
#16092
Parquet Reader: Move decoding logic into separate Decoder classes by \
@Mytherin in #16100
BundleStaticLibs to be also triggered by InvokeCI by @carlopi in #16107
Parquet Reader: Split DeltaLengthByteArray decoder from DeltaByteArray, and \
read the strings in a streaming manner by @Mytherin in #16105
Parquet Dictionary reader: set NULL values as the last value in the \
dictionary by @Mytherin in #16106
Parquet Reader: Share ResizeableBuffers across decoders, and unify \
Plain/PlainReference by @Mytherin in #16113
Using GitHub ARM runners for Linux CLI builds by @hannes in #16119
Parquet Reader: Implement dedicated Skip method by @Mytherin in #16117
Use ColumnSegment::FilterSelection and SelectionVector for filtering in \
Parquet scans by @Mytherin in #16126
[Dev] Fix output (long lines > 333 characters) getting truncated in shell \
by @Tishj in #16128
Adaptive table filter: initialize filter order based on heuristics by \
@Mytherin in #16127
Feature #16044: TimeZone Offset Seconds by @hawkfish in #16048
ATTACH OR REPLACE database to allow swapping of new data. by @xevix in #15355
[Dev] Remove upsert_conflict_in_different_chunk.test by @Tishj in #15980
[Dev] Fix issue related to unpacked columns and the NOT operator by @Tishj \
in #15534
[Julia] Add support for named params in prepared statements by @tqml in #15621
Use Adaptive Filters in the Parquet reader by @Mytherin in #16133
Parquet reader: push table filters directly into dictionaries by @Mytherin \
in #16136
Parquet reader: Plain templates - make CHECKED a template parameter, and use \
memcpy/bulk skip when reading/skipping without defines by @Mytherin in #16141
Parquet reader: only set invalid entry in the dictionary when the column has \
defines by @Mytherin in #16144
Add uniq_ptr_cast for interpreted benchmark. by @Tmonster in #16151
Hopefully fixing ci runs by @hannes in #16150
Removed the last CI job that used the Ubuntu 18 setup by @hannes in #16155
Parquet Reader: Split CreateReader into two separate stages - ParseSchema \
and CreateReader by @Mytherin in #16161
Have CSV Parellel tests on CI again by @pdet in #16164
[Python][Dev] Bump the minimum pybind11 version from 2.6 to 2.9 by @Tishj in \
#16159
Add StackTraces to FatalExceptions by @NiclasHaderer in #16158
Rework invoke by @carlopi in #16108
Adds pre-optimization hooks for DuckDB by @NiclasHaderer in #16115
Unify behavior of range/generate_series with PostgreSQL by @kryonix in #15935
[CI] Avoid Linux CLI jobs to fail-fast by @carlopi in #16173
Parquet: Add dedicated Select method that can be used to push selection \
vectors into the read by @Mytherin in #16174
Unvendor ICU by @m-kuhn in #16176
Parquet reader: batch check if buffer is available in RLEBpDecoder by \
@Mytherin in #16185
Parquet Reader: for DeltaLengthByteArray encoding, directly refer to strings \
from the block without copying by @Mytherin in #16186
unified names for duckdb-extensions by @hmeriann in #16179
Only delete test directory when --test-temp-dir is not specified by \
@Mytherin in #16192
Fix #16163: COLUMNS should not treat identifiers as strings by @Mytherin in \
#16193
Parquet reader: Avoid applying bloom filters if we are casting columns by \
@Mytherin in #16194
Pretty print sniffer values by @pdet in #16182
V1.2 histrionicus by @Mytherin in #16191
Bump Julia by @Mytherin in #16199
Ensure that dependent targets are present after find_package. by @BillyONeal \
in #16197
Concurrency groups for R and Wasm by @hmeriann in #16201
Parquet Writer Cleanup: Move ColumnWriters to separate files by @Mytherin in \
#16202
[fix] Use bigobj when building with MSVC by @m-kuhn in #16200
Improve performance of UNNEST/UNPIVOT by using selection vectors to unnest \
multiple lists at once by @Mytherin in #16210
Add the TRY expression by @Tishj in #15939
[Python][Dev] Replace the default connection when it's closed by @Tishj in #16160
Use steady clock for profiler by @dentiny in #16198
Add parallel memset ting the input columns of the UNPIVOT operator in the \
UNNEST by @Mytherin in #16221
Left join push down optimization by @Damon07 in #15881
Do In-Filter pushdown in PyArrow by @pdet in #16224
Use _win32 with MSVC by @cfis in #16235
Fix PythSV/JSON readers by @Mytherin in #16248
Modify histogram test to more fuzzily check boundaries since the test can be \
inconsistent on different platforms by @Mytherin in #16261
[Dev] Fix issue in TRY expression with dictionary_expression Vector veri \
Fix extension install mode null by @samansmink in #16268
A little cleanup. by @JasonPunyon in #16028
Improve Parquet writer performance by @lnkuiper in #16243
Merge v1.2-histrionicus into main by @Mytherin in #16284
Many reclaim storage6246
Add pragma to truncate duckdb log storage by @samansmink in #16274
Some more Parquet writer performance improvements by @lnkuiper in #16287
Do duckdb_extract_statements to be able to execute pivot in ADBC by @pdet in \
#16162
[Dev] Improve/Add handling of escapes in VARCHAR -> list/struct/map and \
align behavior by @Tishj in #15944
make ValidityMask::RowIsValidUnsafe really unsafe by @xuke-hat in #16302
Multi File Reader Rework: Add MultiFileReaderFunction that is used to wrap a \
single-file reader, and use it for the Parquet reader by @Mytherin in #16299
[Python Dev] Add support for fully qualified references in .table(...) \
method by @Tishj in #16291
[Dev] MultiFileReader - Add to the column_indexes for file_row_number by \
@Tishj in #16311
Parquet reader performance by @lnkuiper in #16315
Bump Julia FixedPointDecimals dependency version by @mbarbar in #16323
Merge V1.2 histrionicus into main by @Mytherin in #16324
Add new recursive semantics (USING KEY) by @cryoEncryp in #12430
fix: add StringStats::SetMaxStringLength by @rustyconover in #16326
Fix decorrelation of WITH USING KEY by @kryonix in #16330
Issue #16250: Window Range Performance by @hawkfish in #16320
Verify UTF-8 in DeltaLengthByteArrayDecoder and speed it up by @lnkuiper in \
#16328
Add missing include by @Mytherin in #16342
[chore] No ccache for OSX Python by @carlopi in #16348
Linux CLI: override platform for ARM manylinux by @carlopi in #16347
docs: tweak explanation of median for even cardinality inputs by @NickCrews \
in #13726
[parquet] Fix implicit idx_t to int64_t conversion flagged by clang-tidy by \
@carlopi in #16368
Improve error message on failure to install local extension by @carlopi in #16371
MAIN_BRANCH_VERSIONING: main branch to get descriptors like v1.3.0-dev1234 \
instead of v1.2.1-dev1234 by @carlopi in #16366
Parallel HT Zeroing: Set entries_per_task so that there are 4x more tasks \
than threads by @gropaul in #16301
Internal #2176: SUMMARIZE Temporal Types by @hawkfish in #16095
[SwiftRelease CI] fetch tags before checking there is already a tag with the \
same name by @hmeriann in #16376
Push Select into ArrayColumnData to avoid scanning arrays that are not \
required for the query by @Mytherin in #16356
Revert "Linux CLI: override platform for ARM manylinux" by \
@carlopi in #16374
Rework CSV Reader: use the new MultiFileReaderFunction interface by \
@Mytherin in #16349
Add connection and transaction identifiers by @samansmink in #16296
Add parquet 'unknown' logical type by @hannes in #16378
Internal #4287: INTERVAL Times DOUBLE by @hawkfish in #16386
pb/compressed vector serialization by @peterboncz in #16066
Fix issue #16377 by @kryonix in #16391
Read support for Parquet Float16 by @hannes in #16395
MAIN_BRANCH_VERSIONING: Adopt also for Python build and amalgamation by \
@carlopi in #16400
Fuzzer Fix: Fix Avg for NULL cast to TIMESTAMP by @Tmonster in #16394
[FriendlySQL] Expand functionality of the Unpacked COLUMNS expression by \
@Tishj in #16290
Python Client: Faster Python Object Conversion by @Mytherin in #16431
Fixup #16400 by correctly passing down SETUPTOOLS_SCM_PRETEND_VERSION by \
@carlopi in #16435
Issue #16250: Window Range Performance by @hawkfish in #16438
Merge v1.2-histrionicus into main by @Mytherin in #16439
MAIN_BRANCH_VERSIONING: Add also prefix_version by @carlopi in #16441
[no-op] Remove unused function GetValueRefUnsafe by @dentiny in #16440
Filter Combiner Clean-up: move filter pushdown to separate functions, remove \
old commented out code by @Mytherin in #16443
[Python] Add the SQLExpression method to the Expression API by @Tishj in #16424
[Dev] Mention the problematic type in UNNEST BinderException by @Tishj in #16429
Merge v1.2 into main again by @Mytherin in #16447
Filter Combiner: Allow rowid pushdown for IN/OR filters and pushdown for \
temporal types by @Mytherin in #16450
Parquet: always launch max threads if we are scanning multiple files by \
@Mytherin in #16457
fix documents of C functions by @yiyuanliu in #16357
Add a TableFilterState for execution of table filters by @Mytherin in #16461
Mirror discussions to the internal repository by @szarnyasg in #16464
Rework JSON Reader: use the new MultiFileReaderFunction interface by \
@Mytherin in #16477
Speed-up contains by using memchr on every iteration by @Mytherin in #16484
Fix error cases by @Y-- in #16494
Prevent external joins (if possible) by @lnkuiper in #16430
Merge v1.2 into main by @Mytherin in #16517
Optimize FSST decoding by @lnkuiper in #16508
Extract subsystem by name by @dentiny in #16226
Avoid throwing an exception (that is then swallowed) when computing \
compressed materialization over stats that are not set by @Mytherin in #16532
Checksum backward compatibility by @lnkuiper in #16505
Prefetch Parquet page header by @lnkuiper in #16507
Let GitHub render *.test files as SQL by @mlafeldt in #16534
Fix ADBC to properly quote table and schema names by @CurtHagenlocher in #16526
Pass ClientContext to catalog initialize, and postpone index binding when \
replaying the WAL by @Mytherin in #16536
Allow UNITTEST_ROOT_DIRECTORY to be configured through CMake by @Mytherin in \
#16540
Internal #4347: ISO Year Week by @hawkfish in #16567
throw() -> noexcept in skiplist by @r-barnes in #16548
Fix test/sql/aggregate/aggregates/histogram_table_function.test to pass the \
Linux CLI (arm64) CI by @hmeriann in #16538
feat: move GRANT from reserved to unreserved keyword by @stephaniewang526 in \
#16546
Python test runner: Avoid enabling profiling when executing restart command \
by @Flogex in #16547
Add duckdb_prepared_statements by @Tishj in #16541
[minor] Keep bit type sanity check consistent by @dentiny in #16575
Support CREATE TABLE AS ... WITH NO DATA by @hannes in #16586
Parquet FLOAT16 - fix cast by @hannes in #16580
remove invalid tokens from nanosecond example by @hamilton in #16577
CrossVersion.yml: Add v1.2.1, v1.2-histrionicus and main by @carlopi in #16576
Fix #16524: DEPENDENT_JOIN may not flatten by @flashmouse in #16537
[Julia] Add support for appending duckdb List types by @era127 in #16512
[PySpark] - Add expr function by @mariotaddeucci in #16468
regex_replace no longer swallows regex errors by @hannes in #16380
Parquet Writer Clean-up: Split CreateWriterRecursive into two methods, and \
use ParquetColumnData for writer as well by @Mytherin in #16592
Bump Julia to 1.2.1 by @Mytherin in #16593
Improved appender error message by @NiclasHaderer in #16599
Change static variables to be on the stack instead by @Y-- in #16597
Add support for RETURN_STATS to COPY by @Mytherin in #16595
Better error messages for the CSV Scanner by @pdet in #16585
Support Enum types in read_csv - Python by @pdet in #15710
Fix CI Tidy by @pdet in #16610
Add some minor helper functions (QueryResultIterator::IsNull and casts to \
MultiFileList/Reader by @Mytherin in #16611
Add support for ALTER TABLE tbl SET PARTITIONED BY (key1, key2, ...) in the \
grammar by @Mytherin in #16612
Issue template: direct UI issues to the UI repository by @szarnyasg in #16619
[Dev] Make the various mappings in MultiFileReaderData typesafe by @Tishj in \
#16596
Bump mbedtls to 3.6.2 and re-apply patches by @hannes in #16485
Read and Write Complex Json from Arrow Types by @pdet in #16385
Add Docker support for RISC-V CI with appropriate build commands by @mocusez \
in #16549
Fix missing **kwargs in adbc_driver_duckdb.dbapi.connect() by @davlee1972 in \
#16637
[Dev] Clean up and fix the CGroup memory/cpu limit discovery logic by @Tishj \
in #16608
Expose Value::ToSQLString() in C API by @mt-caret in #16471
Add the missing binding for json_serialize_sql by @liznear in #16666
Do not create validity mask for non-null const vector by @xuke-hat in #16669
Fix #16665: fix parquet multi_reader bloom_probe logic error by @flashmouse \
in #16677
Add alias to catalog by @c-herrewijn in #16600
Decouple physical operator ownership from operators by @taniabogatsch in #16545
cmake: fix external icu by @autoantwort in #16676
Character length and date functions by @hannes in #16653
[Dev] Don't try to include third_party/mbedtls/VERSION with package_build.py \
by @Tishj in #16683
Add -ui to CLI help text by @akx in #16626
Fix alias of column reference lost in ReplaceProjectionBindings by @Damon07 \
in #16686
Merge v1.2-histrionicus into main by @Mytherin in #16687
Fix for GCC-4.8 by @Mytherin in #16690
JSON Reader: make read_position atomic so this can be read by the progress \
bar while processing the JSON file by @Mytherin in #16692
[Julia] support binding for vectors by @slwu89 in #16701
Make CSV Parser strict_mode=True fail on a mix of new line delimiters. by \
@pdet in #15959
[pypi] Fix cleanup logic for multiple branches by @hmeriann in #16634
Add support for ALTER TABLE tbl SET SORTED BY (key1 DESC, key2, ...) in the \
grammar by @Mytherin in #16714
RETURN_STATS: remove footer_offset, and emit written partition keys by \
@Mytherin in #16715
In case all rows of a CSV batch are errors, we continue processing by @pdet \
in #16713
add workaround for patching httpfs ext by @samansmink in #16722
Implement UUID v7 by @dentiny in #15819
Fix roundtripping of stringified nested types by @Tishj in #16304
Add Notify External Repositories Workflow by @maiadegraaf in #16730
Expose a selection vector and the Slice method to the C API by \
@joseph-isaacs in #16696
Add support for tracking column_size_bytes and contains_nan in RETURN_STATS \
by @Mytherin in #16731
Add support for WRITE_EMPTY_FILE option to COPY - which allows skipping of \
writing empty files by @Mytherin in #16737
Parquet Writer: Truncate string stats for large strings, instead of bailing \
on writing stats by @Mytherin in #16736
RLE compression - memset alignment bytes to zero when aligning the counts by \
@Mytherin in #16735
Write UUID stats to Parquet files and support reading uuid stats by \
@Mytherin in #16744
Add an initial value to list_reduce by @maiadegraaf in #16602
shell: make -bail work for more errors by @mlafeldt in #16594
Call Notify External Repositories from Invoke CI by @maiadegraaf in #16747
JSON bugfixes by @lnkuiper in #16729
Add support for dynamically providing extra info post-execution in table \
functions, and use this to emit the total number of files read by the \
MultiFileReader by @Mytherin in #16749
[Python Dev] Fix the versioning of the nightly python builds by @Tishj in #16739
shell: fix sometimes-uninitialized error by @mlafeldt in #16761
Issue #16250: Window Range Performance by @hawkfish in #16765
Avoid building Python 3.7 wheels also for Linux by @carlopi in #16769
Pyodide 0.27.2: conditionally skip tests by @carlopi in #16772
Push catalog lookups through an extensible EntryLookupInfo struct by \
@Mytherin in #16764
Fix two minor problems with NotifyExternalRepositories / odbc by @carlopi in \
#16776
update expected results reflecting the changes brought ups with Fix \
roundtripping of stringified nested types PR by @hmeriann in #16775
Merge V1.2 -> Main by @pdet in #16751
Add support for time travel syntax in the FROM clause by @Mytherin in #16774
Python docs: List all join types by @szarnyasg in #16789
[chore] NotifyExternalRepositories.yml: Fix endpoint to be pinged by \
@carlopi in #16793
Remove delta from extensions built on a nightly basis (vs main branch) by \
@carlopi in #16795
OSX.yml & Windows.yml: remove repository_dispatch, already handled by \
InvokeCI by @carlopi in #16796
Make extensions be linked privitally into duckdb by @JAicewizard in #16726
Add additional iterations to avoid assertion failure in \
TemporaryMemoryManager by @lnkuiper in #16801
Change the STANDARD_MASK_SIZE calculation to use size of template type. by \
@sebastiaan-dev in #16807
Fix nightly table sample error by @Tmonster in #16811
Fix tidy by @pdet in #16805
support 'categories' label in function catalog by @c-herrewijn in #15654
regenerate function headers by @c-herrewijn in #16822
Internal #4490: Window Jump Reset by @hawkfish in #16816
Regression.yml: Actually checkout proper base.sha commit by @carlopi in #16824
fix: drop useless python import by @yihong0618 in #16808
NightlyTests.yml: Inline env variables into build command by @carlopi in #16817
Benchmark runner summary by @hmeriann in #16759
Add storage_version 66 for version 1.3.0 by @carlopi in #16800
Revert "fix: drop useless python import" by @Mytherin in #16834
[MultiFileReader] Rework MultiFileReader::FinalizeChunk to use Expressions \
by @Tishj in #16630
Merge v1.2 into main by @Mytherin in #16832
Fix NULL key handling in mark join by @xuke-hat in #16825
compressed vector serialization fixes by @peterboncz in #16648
really sorry about this by @peterboncz in #16840
Fix Python docstrings for unique by @szarnyasg in #16845
[MultiFileReader] Create "local" filters to hand to underlying \
readers by @Tishj in #16838
Revert "Regression.yml: Actually checkout proper base.sha commit" \
by @Mytherin in #16860
[ART] Immediately erase empty fixed-size buffers by @taniabogatsch in #16727
Resolve defaults and column index map by pushing a Projection (instead of \
executing in the insert itself) by @Mytherin in #16867
Fix issue with sorting dev versions in pypi_cleanup.py script to keep on \
PyPi the most recent dev versions by @hmeriann in #16873
Allow filters to be pushed through joins if there are projection maps by \
@lnkuiper in #16871
Expressions in create secret by @samansmink in #15801
Python - Arrow IPC support in from_arrow by @pdet in #16821
[ART] Introduce a new ARTScanner and make InitMerge and Vacuum iterative by \
@taniabogatsch in #16861
Do not pushdown filters which bindings only match the right side of the left \
join by @Damon07 in #16880
MultiFileReader Rework (part 17) - remove MultiFileReaderData - and move as \
much as possible out of the file readers by @Mytherin in #16882
ICU: Unify TimeZone accessing code by @Mytherin in #16887
Rework ICU age computation to convert to a timestamp and use the regular \
interval age computation by @Mytherin in #16889
Reduce allocations during aggregations by @lnkuiper in #16849
CI: Prevent marking issues as 'stale' if they have the 'no stale' label by \
@szarnyasg in #16903
Add field name to log line which fails Parquet spec by @jsbali in #16862
Internal #4490: Window Threading Cleanup by @hawkfish in #16879
Adding gzip version of shell for linux/osx install script by @hannes in #16116
Fix USING KEY reference error by @kryonix in #16906
[Nested] Enable Varargs in LIST_CONCAT by @maiadegraaf in #16870
Fix several issues with vsize=2, and move vsize=2 tests to Main.yml by \
@Mytherin in #16918
C API comments: Fix a/an typos by @szarnyasg in #16925
Reduce locking with FILE_SIZE_BYTES/ROW_GROUPS_PER_FILE in Parquet writer by \
@lnkuiper in #16928
[Python] Fix annotation of condition argument in join so it accepts \
Expression by @MarcoGorelli in #16933
Fix GCC 4.8 and add it back to Main workflow by @Mytherin in #16937
Merge v1.2 into main again by @Mytherin in #16939
MultiFileReader - Perform nested remapping of field indexes instead of \
relying on casts by @Mytherin in #16941
Internal #4552: Short Circuit CSE by @hawkfish in #16931
Add back manylinux extensions by @carlopi in #16944
Run CI on merge group by @Mytherin in #16945
Internal #4516: Interval BIGINT Variants by @hawkfish in #16904
Split query string for multi-statement queries by @Mytherin in #16955
Vector Verification: Rework to run based on env variable \
DUCKDB_DEBUG_VERIFY_VECTOR and move to Main.yml by @Mytherin in #16957
Move the no string inline/alternative verify workflow to Main.yml by \
@Mytherin in #16958
[Python] Tighten type annotations on shape and columns by @MarcoGorelli in #16948
Pass down CMAKE_POLICY_VERSION_MINIMUM and fix for local development by \
@carlopi in #16953
[ART] Use the ARTScanner for VerifyAllocations (make it iterative) by \
@taniabogatsch in #16946
Move ThreadSanitizer test from nightly test to Main, and fix locking issue \
by @Mytherin in #16960
Re-enable workflows to run on PRs by @Mytherin in #16961
Fix for selecting NaN values from Parquet files by @Mytherin in #16962
Move LatestStorage tests to NightlyRelease - and fix issue with overflow \
string blocks not being cleaned up correctly by @Mytherin in #16972
Arena-allocate physical operators by @taniabogatsch in #16911
Make file_row_number a virtual column, and support per-file virtual columns \
in the MultiFileReader by @Mytherin in #16979
Add a setting scheduler_process_partial that allows partial scheduling of \
tasks in the background threads by @Mytherin in #16973
Clean up format script, gather all files then run concurrently instead of \
running concurrently per directory by @Mytherin in #16988
Add support for altering struct columns (adding fields, dropping fields, \
renaming fields) by @Mytherin in #17003
Fix CSV fuzzer tests by @pdet in #16994
[Fix] Keep original expression for macro + lambda's with subqueries by \
@taniabogatsch in #17020
Detect when tables have been dropped or altered, and prevent deletes in this \
scenario by @Mytherin in #17018
Update links pointing to duckdb.org by @szarnyasg in #16999
Fix for joining on floating columns #16901 by @nickzoic in #16965
fix: remove ununsed stream struct member from ArrowScanLocalState by \
@rustyconover in #17023
[Dev] Use UnifiedVectorFormat instead of a flattened Vector in \
UpdateSegment::Update by @Tishj in #16974
Remove Arrow Extenson from core extensions by @pdet in #17027
Correctly propagate ClientContext to TaskExecutor by @ywelsch in #17026
Issue #17001: AsOf memory Management by @hawkfish in #17028
[MultiFileReader] Make it possible for the multi file reader to add a \
DeleteFilter to the BaseFileReader by @Tishj in #17032
Add optional OVERRIDE_NEW_DELETE build parameter by @lnkuiper in #17035
Clean-up virtual columns and make MultiFileReader::InitializeReader virtual \
by @Mytherin in #17038
Allow a table to define their own row-id columns for delete/update, instead \
of assuming it is always COLUMN_IDENTIFIER_ROW_ID by @Mytherin in #17039
Handle Parquet with compressed empty DataPage v2 by @EnricoMi in #17031
Combine small row groups in Parquet writer by @lnkuiper in #17036
Merge v1.2.2 into main by @carlopi in #17037
implement function so I can send a patch to httpfs by @lnkuiper in #17048
FORCE_ASYNC_SINK_SOURCE: pass also to unittester by @carlopi in #17053
If a Max Line Size Error happens on all CSV dialect candidates, throw a max \
line size error. by @pdet in #16935
Expose BindExtraColumns as a public function by @Mytherin in #17060
trigger .github/workflows/NightlyBuildsCheck.yml from external repo by \
@hmeriann in #16949
Minor parquet crypto clean-up: allow footer key to be passed in directly, \
and avoid constantly re-reading the key from the config by @Mytherin in #17070
update julia to v1.2.2 by @Maxxen in #17074
MultiFileReader Rework (part 18): Replace file path with OpenFileInfo struct \
by @Mytherin in #17071
Fix httpfs patches: avoid git log since might contain unsanitised error word \
by @carlopi in #17075
Re-enable Avro on core by @Tishj in #17072
[Nested] Optimize List Type in list_value by @maiadegraaf in #17063
Grow string dictionary dynamically in Parquet writer by @lnkuiper in #17061
Add extended file info to OpenFileInfo, and use this to pass encryption keys \
and footer size to Parquet reader by @Mytherin in #17085
[Dev] Automatically re-execute when calling __arrow_c_stream__ on an \
already-consumed-result by @Tishj in #17087
fsst: Avoid to propagate alignment information in FSST_UNALIGNED_STORE by \
@carlopi in #17094
Fix sqlite3 api wrapper link + remove R-CMD-check + add more nightly tests \
by @carlopi in #17095
support large dictionary value and constant vector creation in the C API by \
@joseph-isaacs in #17064
Add missing lock to UpdateSegment::FetchRow, and cleanup API to require the \
lock by @Mytherin in #17100
Valgrind requires tpch by @carlopi in #17101
Switch to manylinux_2_28 by @hannes in #16956
Changing mbedtls encryption API by @ccfelius in #16196
Pull OpenFileExtended through the opener and virtual file system layers by \
@Mytherin in #17102
Fix an issue in upserts where the local append state was not correctly \
flushed by @Mytherin in #17109
Always parallelize read_json schema detection by @lnkuiper in #17106
Move transaction cleanup outside of the transaction lock by @taniabogatsch \
in #17034
Remove R_CMD_CHECK.yml, now handled by duckdb/duckdb-r repo by @carlopi in #17127
JSON Bugfixes by @lnkuiper in #17119
Refactor relassert runs, adding some variations in compiler / statically \
linked extensions by @carlopi in #17104
extension-upload-from-nightly.sh: Add --region by @carlopi in #17120
MultiFileReader: several fixes for virtual column handling and make virtual \
column handling extensible by @Mytherin in #17123
Remove misleading lock comment in data table by @taniabogatsch in #17125
[Dev] Add "registries" to vcpkg.json, add script to list the \
packages of the registry. by @Tishj in #17124
External File Cache by @lnkuiper in #16463
Notify nightly build status by @hmeriann in #17108
Strict UUID cast by @lnkuiper in #17138
Copy To File: avoid calling Combine for threads that have not written any \
rows by @Mytherin in #17142
Add file_index virtual column to the multi file reader that returns the file \
index of the read file by @Mytherin in #17144
MultiFileReader: simplify constant handling, and allow virtual columns \
returned by the multi file reader to be constant by @Mytherin in #17149
Changes to encodings to make them more flexible to replacement maps. by \
@pdet in #17146
Optimize large Top N queries by @lnkuiper in #17141
Only trigger TopN rewrite relatively small limits compared to the table \
size. by @Tmonster in #17140
platform.hpp: Propagate DUCKDB_EXPLICIT_PLATFORM, avoid early return by \
@carlopi in #17137
Keeping the filters which do not remove NULL values by @Damon07 in #17045
Improve FileSync call on unix platform by @dentiny in #16893
README: Fix to building link by @szarnyasg in #17161
[InvokeCI] Add missing pipe to run instruction by @hmeriann in #17163
Internal #4667: 2025b TimeZone Data by @hawkfish in #17160
Unify function list by @c-herrewijn in #17168
[Dev] Generate the EXTENSION_SECRET_TYPES instead of hardcoding them by \
@Tishj in #17183
Fix grouping feature with interval type by @handstuyennn in #17181
Add filename to GZIP stream error by @marcoslot in #17166
Issue #17115: TimeTZ Approximate Quantile by @hawkfish in #17162
Issue #17046: AsOf Left Predicates by @hawkfish in #17159
[Fix] Pass delete indexes when committing updates by @taniabogatsch in #17176
Python.yml: Add back logic to perform fast-fail on Python 3.10 by @carlopi \
in #17107
Notify JDBC repo to run Vendor.yml workflow by @staticlibs in #17099
Issue #17049: ICU Date Cast by @hawkfish in #17067
Add bind_operator callback to TableFunction - allowing table functions to \
directly emit a LogicalOperator by @Mytherin in #17196
[ENCRYPTION] Make block header size adaptive by @ccfelius in #17118
Issue #16839: Disable TIMESTAMP Casts by @hawkfish in #16899
Add support for an explicit PRESERVE_ORDER flag for copy to file by \
@Mytherin in #17199
Add SYSTEM_PEAK_BUFFER_MANAGER_MEMORY and SYSTEM_PEAK_TEMP_DIRECTORY_SIZE to \
profiler by @lnkuiper in #17164
Fix [InvokeCI / NotifyExternalRepository] Unexpected value 'true' by \
@hmeriann in #17212
Add support for the cast_to_type function, that allows generating a cast \
from an expression to the type of another column by @Mytherin in #17209
Better cardinality estimates for inequality joins/grouped aggregations by \
@lnkuiper in #17139
Add ExternalFileCache validation as option for ExtendedOpenFileInfo by \
@lnkuiper in #17205
Explicitly flush the thread-local optimistic writer in PhysicalBatchInsert \
when finalizing by @Mytherin in #17214
Pushdown arbitrary expressions into scans by @Mytherin in #17213
Fix #17170: sort selection result in OR expression by @flashmouse in #17180
[Dev] Re-enable Iceberg, Bump Avro, fix generate_extension_functions.py for \
dependencies between extensions by @Tishj in #17204
Change Invalid Unicode Error to Invalid Encoding by @pdet in #17208
Direct IO for temp files by @lnkuiper in #17219
Fix [InvokeCI / NotifyExternalRepository] GitHub Actions has encountered an \
internal error when running your job. by @hmeriann in #17218
Add "thousands" option to CSV Reader by @pdet in #17220
add capi functions to create map and union values by @jraymakers in #17227
Only notify JDBC when all runs are successful by @staticlibs in #17233
Update Friendlier SQL link.md by @hfrifkin in #17248
Implement reading concatenated GZIP members by @lnkuiper in #17255
Return invalid BufferHandle upon loading a destroyed BlockHandle by \
@lnkuiper in #17249
Internal #4772: Timestamp Error Parameter by @hawkfish in #17283
BUGFIX: do not perform unused columns optimization in presence of multiple \
grouping sets by @Tmonster in #17259
Internal #4532: 13 Month Intervals by @hawkfish in #17303
Dont try to load extension if storage type is already registered by @Maxxen \
in #17241
Adapt size of hash table during aggregation using HyperLogLog by @lnkuiper \
in #17236
Switch to always using list identifier instead of array by @J-Meyers in #17242
Add root's query_location also to TransformInterval by @carlopi in #17271
Histogram table function test by @hmeriann in #17276
Guess Parquet footer size by @lnkuiper in #17300
Issue #16563: FLOAT to DECIMAL by @hawkfish in #17302
Feature #15873: Windowed ORDER BYs by @hawkfish in #17304
Switch from Bottom-Up to Top-Down Decorrelation Strategy by @kryonix in #17294
Generating random data for mbedtls without key by @ccfelius in #17309
Fix CI by @Mytherin in #17319
[Arrow] Implement support to consuming and producing Decimal 32 and 64. by \
@pdet in #17314
take the column ids from the logical get, don't require a LogicalGet … by \
@Tishj in #17315
Allow installing extensions with external access allowlist by @samansmink in \
#17316
Implement ARTMerger replacing the recursive ART merge algorithm by \
@taniabogatsch in #17243
Share null mask with constant null arg vector by @iceTTTT in #17234
Fix #17311: correctly check for presence of recursive keys in transformer by \
@Mytherin in #17320
[CSV Reader] Simplify Quote/Escape detection code, make it more robust and \
decouple comment and skip_rows option. by @pdet in #17284
Fix try_cast from NaN double to decimal by @lnkuiper in #17322
Add serialization for new TableColumn type by @Mytherin in #17321
Extract expressions from nested conjunction AND for index scan by @lnkuiper \
in #17297
Support late materialization in the Parquet reader, and handle COUNT(*) \
directly in the multi file reader by @Mytherin in #17325
Implement ARTOperator replacing Lookup and the recursive Insert by \
@taniabogatsch in #17327
Internal #4723: Inequality Condition Pushdown by @hawkfish in #17317
Properly format strings when throw JSON errors by @lnkuiper in #17331
Fix potential vulnerable cloned function by @npt-1707 in #17340
Fix potential vulnerable cloned function by @npt-1707 in #17339
Revert "Skip MinGW, currently failing on main" by @carlopi in #17342
Unify Parquet Metadata cache invalidation logic with Cached File System \
cache invalidation by @Mytherin in #17334
Fix issue with empty ranges by @kryonix in #17332
Internal #4797: Timestamp Range Cardinality by @hawkfish in #17330
Some nitpicking fixes by @szarnyasg in #17337
Issue #17299: Integer Rounding by @hawkfish in #17328
Parquet Reader: emit partition stats for any files that have cached \
metadata, and implement ListFilesExtended that adds extra info to files globbed \
by @Mytherin in #17344
Add support for UUID v7 to Filename Pattern - and clean it up so that it \
correctly supports composite patterns by @Mytherin in #17345
Add support for the HIVE_FILE_PATTERN option - that allows partitioned files \
to be written without writing them to a hive-style directory structure by \
@Mytherin in #17346
Add an OnDetach callback to the catalog that is triggered when the user \
detaches a catalog by @Mytherin in #17347
Pass commit ID to NotifyExternalRepositories.yml by @staticlibs in #17333
Add support for BENCHMARK_ROOT_DIRECTORY cmake option to change benchmark \
runner root directory, and add support for cache_file and reload options to \
enable better caching for non-DuckDB databases by @Mytherin in #17355
Support --directories option in format.py by @Mytherin in #17354
Handle both ENCRYPTION_KEY and STORAGE_VERSION passed as options by @carlopi \
in #17357
Fix internal exception from assigning invalid index to optional_idx \
query_id; by @Tishj in #17359
Fixup amalgamation: reqlen is only used with assert enabled by @carlopi in #17361
md5_number: return UHUGEINT by @szarnyasg in #17336
Skip emitting partition stats if "has_deletes" is set in the file \
info by @Mytherin in #17365
Benchmark runner: add argument, include and load_only options - and make \
ClickBench run the original benchmark instead of a subset by @Mytherin in #17367
Fix two off-by-one errors in row estimate of range and generate_series by \
@JelteF in #17373
[Nested] Fix: 16489 - Find NULLs in lists using list_position by \
@maiadegraaf in #17080
fix #17258: Allow to open database in readonly mode within cli by @jjballano \
in #17375
Join Hash Table Probing Optimization: Optional Probing Selection Vector by \
@gropaul in #17062
Remove bundled TPCH & TPCDS in Python wheels by @carlopi in #15923
[Compression] Introduce DICT_FSST compression method by @Tishj in #15637
Deprecate lambda arrow (->) and replace it with LAMBDA x : x + 1 by \
@taniabogatsch in #17235
fix not setting nested validity when map_extract returns null by @Maxxen in \
#17379
Function chaining: report missing column instead of missing function if \
function exists by @Mytherin in #17383
Improve error messages in UPDATE ... SET by @Mytherin in #17384
Add candidates suggestion when COLUMNS regex does not match any columns by \
@Mytherin in #17385
add step to clean up the disc space to fix No space left on device by \
@hmeriann in #17390
Fix issue in string -> hugeint conversion with decimals and exponents by \
@Mytherin in #17388
Improve error message reporting for cast failures by @Mytherin in #17382
Fix Python CI: pin virtualenv to previous version by @Mytherin in #17386
Improve error reporting for missing qualified columns by @Mytherin in #17397
Issue #17266: Lead Lag Nulls by @hawkfish in #17391
Fix #17266：the result of lad/lead when the offset is null by @ditdb in #17268
VirtualFileSystem to take an input, allowing to customize behaviour by \
@carlopi in #17393
[Dev] Add QualifiedName::ParseComponents, add input to the error messages by \
@Tishj in #17403
Provide suggestions and a link to the documentation for OOM errors by \
@Mytherin in #17402
[Dev] Flatten any deeper children vectors, when the top level is a FLAT \
vector by @Tishj in #17387
Minor fixes for the CLI by @Mytherin in #17405
Add support for CREATE OR REPLACE TYPE, CREATE TYPE IF NOT EXISTS and CREATE \
TEMPORARY TYPE by @Mytherin in #17404
Use an insertion order preserving map in Value::MAP by @taniabogatsch in #17389
Implement json_each/json_tree by @lnkuiper in #17406
Fix #16552: adjust join condition sequence by @flashmouse in #16943
WAL replay index fixes by @taniabogatsch in #17409
ZSTD: use a high penalty when min size is exceeded instead of disabling \
compression to allow force compression to work by @Mytherin in #17412
Internal #4723: PWMJ Inequality Pushdown by @hawkfish in #17400
Move all httplib code to HTTPUtil class by @Mytherin in #17420
Avoid generating default views and macros in the temporary catalog by \
@Mytherin in #17408
unittest: improve detection of whether or not we can run --force-restart \
tests by @Mytherin in #17419
Give tasks a TaskType with a name by @Mytherin in #17421
Use argparse in scripts/format.py by @adsharma in #17360
Add missing commas by @szarnyasg in #17424
Internal #4830: IEJoin Inequality Pushdown by @hawkfish in #17422
Add conn.query_progress() method by @nickzoic in #16927
Fixes filter pruning use the statistics updated by the same filter by \
@Damon07 in #17425
Fix JSON extension compilation on Ubuntu 22.04 by @staticlibs in #17434
Use pytest in SQLLogic Python test runner by @Flogex in #16685
On COPY TO/FROM check the format during binding. by @pdet in #17381
BUGFIX: DELIM_JOINS should reflect functionality of NULL filtering \
conditions in joins with DELIM_GETS by @Tmonster in #16910
Allow directly attaching of Parquet/CSV/JSON files by @Mytherin in #17415
Force errors when trying lines as early as possible by @pdet in #17427
Enable SYSTEM_PEAK_BUFFER_MEMORY and SYSTEM_PEAK_TEMP_DIR_SIZE profiling by \
default by @lnkuiper in #17407
[C API] Expose the client context, connection id and scalar function bind \
data by @taniabogatsch in #17449
[CSV Sniffer] Proper type replacement in header only files by @pdet in #17447
Recurse into MAP and LIST with the remap_struct and the MFR ColumnMapper by \
@Tishj in #17448
Fix: pyproject.toml does not contain a tool.setuptools_scm section by \
@YUKI2eN3e in #17443
[Fix] Macro binding with unknown parameters in list_has_all and some other \
code tidying by @taniabogatsch in #17450
Generalize HTTP interface and use the new HTTP interface in httpfs by \
@Mytherin in #17464
[Fix] Switch between constant and flat vector in C API by @taniabogatsch in \
#17465
Fix TIMETZ cast in example by @szarnyasg in #17468
Remove duplicated arrow fetch test by @emmanuel-ferdman in #17476
Multi File Reader Rework (Part 19): Make MultiFileReaderInterface virtual, \
and move reading methods to the BaseFileReader by @Mytherin in #17475
[Serializer] Lambda Compatibilty Fix by @maiadegraaf in #17428
fix parsing bool values in JSON by @ccfelius in #17460
Emit dictionary vectors with unaligned start index by @OmidAfroozeh in #17471
Add release version by @hannes in #17479
Expose qualified table names in GetTableNames and add duckdb_get_table_names \
to C API by @taniabogatsch in #17472
Bump avro, httpfs, mysql, postgres and sqlite by @Mytherin in #17482
Fix GeoParquet ExpressionColumnReader schema by @Maxxen in #17481
add regression_threshold_seconds argument to regression/test_runner.py by \
@hmeriann in #17485
DROP of missing entry should fail in binding by @jeewonhh in #17474
HTTPFS Parameters fix by @Mytherin in #17486
HTTPUtil Fix: correctly pass in on_retry by @Mytherin in #17494
Bump spatial & vss by @Maxxen in #17492
Add support for altering structs (drop, add, rename field) inside LIST and \
MAP columns. by @Tishj in #17462
[Python Dev] Guard against python exceptions when interacting with the \
currentframe object by @Tishj in #17490
If distinct count from stats is 0, do not use it in Join Order Optimizer by \
@Tmonster in #17466
Make the encodings extension a core extension, and make it auto-loadable. by \
@pdet in #17206
Allow passing down rc-style version also via OVERRIDE_GIT_DESCRIBE by \
@carlopi in #17501
Allow DUCKDB_EXPLICIT_VERSION to be propagated by @carlopi in #17498
Minor nightly fixes by @Mytherin in #17500
Add FileSystem::TryRemoveFile - that only removes a file if it exists by \
@Mytherin in #17502
Add OperatorFinalize callback to operators - which is called after a \
pipeline is finished by @Mytherin in #17503
Apply dynamic filter pushdown of TopN optimizer also to existing TopN nodes \
by @Mytherin in #17504
Fix: Optional Probe Selection by @gropaul in #17505
FileHandle Logging by @samansmink in #16758
Fix typos by @szarnyasg in #17478
Remove spatial from OSX Relassert by @carlopi in #17509
Update more extensions by @Maxxen in #17510
Bump HTTPFS again by @Mytherin in #17511
feat: include catalog and schema names in function serialization by \
@rustyconover in #17512
Fix encodings by @carlopi in #17514
Fix python nightly build by @Tishj in #17515
Use Catalog::TryAutoLoad for encodings extension by @pdet in #17520
[Python Dev] Using reinterpret_steal breaks the refcount of the passed-in \
object by @Tishj in #17525
Fix update extensions by @carlopi in #17527
Minor fixes to exception error messages by @carlopi in #17528
[Python Dev] Fix failing tests for the Python SQLLogicTester by @Tishj in #17529
Resolve GitHub workflow set-output deprecation warnings by @kurtmckee in #17516
[CSV Reader] Detect SQLNULL types for schema merging, use schema merging in \
csv relations, add files_to_sniff option. by @pdet in #17467
Fix extension test by @carlopi in #17536
[Dev] Fix crash when describing a table with a virtual column by @Tishj in #17544
[HTTPUtil] Let requests made through the HTTPUtil interface accept URI's \
without a scheme. by @Tishj in #17545
Attach after setting database type by @Mytherin in #17546
Pass MultiFileGlobalState to InitializeReader, and pass file list to \
CreateMapping instead of eagerly getting the first file by @Mytherin in #17553
[Dev] Fix allowed_directories crash by @Tishj in #17548
[Fix] duplicate filters during index scans by @taniabogatsch in #17547
Generate data for tpch sf100 in steps by @Tmonster in #17539
Issue #17537: Fractional Second Padding by @hawkfish in #17556
Make MultiFileList::Copy a virtual method by @Mytherin in #17566
[Dev] Can't use USING COMPRESSION with a deprecated compression type by \
@Tishj in #17542
Add (de)serialization for ExtraOperatorInfo by @NiclasHaderer in #17563
Fix issue with ExternalFileCache when data is evicted by @lnkuiper in #17567
Remote Reads: allocate correct buffer size for prefetch by @Mytherin in #17557
Remove patch and bump httpfs by @carlopi in #17558
[Dev] Fix Arrow fixed size binary reading by @Tishj in #17573
Fix setup.py to correctly handle OVERRIDE_GIT_DESCRIBE by @carlopi in #17580
|
| 2025-05-20 18:03:33 by Ryo ONODERA | Files touched by this commit (3) | |
Log message:
databases/duckdb: Update to 1.2.2
Changelog:
1.2.2:
This is a bug fix release for various issues discovered after we released 1.2.1. \
There are no new major features, just bug fixes. Database files created by \
DuckDB versions all the way back to v0.9.* can be read by this version.
What's Changed
[Python] Fix deadlock in from_parquet with file_globs caused by not \
releasing the GIL by @Tishj in #16522
[Python] Fix some stubs issues by @Tishj in #16523
[Dev] Fix issues in the benchmark runner related to the serialized \
storage_version by @Tishj in #16533
Set estimated cardinality to newly created logical operators by @jeewonhh in \
#16528
custom_extension_repository to also be the default \
autoinstall_extension_repository by @carlopi in #16459
[Python Dev] No longer trigger a DeprecationWarning when using a UDF by \
@Tishj in #16433
Fixup problems connected to prep to 1.2.1 by @carlopi in #16578
Give preference to quote=escape if we can't do better by @pdet in #16584
Max ART key length by @taniabogatsch in #16588
Issue #16617: Window Constant Finalize by @hawkfish in #16628
[Fix] Index scan - Move the table scan state into the local state by \
@taniabogatsch in #16650
[Fix] Perform eager constraint checking during physical batch insert by \
@taniabogatsch in #16651
[Python] Don't push down OPTIONAL_FILTER into pyarrow for the arrow scan. by \
@Tishj in #16657
move OrderPreservationRecursive to physical_plan_generator.hpp by @jeewonhh \
in #16656
Add libs folder to bundled static libs by @taniabogatsch in #16655
Avoid UMA by @krlmlr in #16641
Avoid UMA by @krlmlr in #16643
Avoid UMA by @krlmlr in #16642
Several fixes for CSV fuzzer tests by @pdet in #16636
FSST Fix: Correctly detect the situation where we have 3 bytes remaining by \
@Mytherin in #16688
Fix #16627: handle DISTINCT FROM and NOT DISTINCT FROM in zone-map pushdown \
by @Mytherin in #16691
Fix #16554: emit blobs as part of .dump by @Mytherin in #16693
add avro by @samansmink in #16708
Issue #16652: Implicit Ordered Aggregation by @hawkfish in #16718
Issue #16649: SelectNth Remainders by @hawkfish in #16705
[Dev] Fix EXPORT DATABASE missing semicolons in produced schema.sql by \
@Tishj in #16723
Always throw the error that happens the earliest in the CSV Reader by @pdet \
in #16728
Fix #16662 by @lnkuiper in #16732
[Test] Add missing test for eager-constraint checking fix by @taniabogatsch \
in #16745
Clamp reported memory in duckdb_memory by @Mytherin in #16753
CLI -help: Fix default value for -nullvalue by @carlopi in #16755
Apply RLE fix to v1.2 by @Mytherin in #16756
[Arrow] Setting schema of the keys to not null for maps and properly write \
Null columns to arrow by @pdet in #16711
Fix min/max values in numeric cast exception message by @abramk in #16777
[ADBC] Add wrapper to connection new, set options at connection init, if \
any. by @pdet in #16748
Remove delta from extensions built on a nightly basis (vs 1.2-histrionicus) \
by @carlopi in #16794
PhysicalTopN: Buffer-allocated StringHeap by @lnkuiper in #16770
[chore] Add v1.2.2 to storage versions, preparation for upcoming patch \
release by @carlopi in #16799
Fix issue when line is empty by @pdet in #16823
Add extra check in normalize for commit, rollback and abort by @pdet in #16802
Fix #16783: Fix DistributivityRule by @flashmouse in #16804
Internal #4492: Ignore Nulls Orrification by @hawkfish in #16837
Fix #16836: rewrite main column data in case of an update that only modifies \
the validity by @Mytherin in #16851
Initialize type by @pdet in #16848
[CSV Reader] Add check on ever quoted for candidate selection by @pdet in #16868
Clean up partial deletes when encountering a transaction conflict in a \
vector by @Mytherin in #16905
Fix clang-tidy: add missing include by @Mytherin in #16920
Backport "Adding gzip version of shell for linux/osx install \
script" by @carlopi in #16917
Backport "Adding gzip version of shell for linux/osx install \
script"/2 by @carlopi in #16924
Skip tests for Python 3.8, already end-of-life by @carlopi in #16923
Bump to avro version that now support wasm by @carlopi in #16916
Unwrap DUCKDB_EXTENSION__LINKED_LIBS via CMake by @carlopi in #16914
Skip manylinux-extensions-x64 job by @carlopi in #16932
[Fix] Disable recursion for invalidated database error by @taniabogatsch in \
#16907
bump excel (on v1.2) by @Maxxen in #16915
[Fix] Flush local storage before any deletes by @taniabogatsch in #16951
[Python] Fix PyArrow filter pushdown for NaN by @Tishj in #16952
Allow overriding the Printer::Print output destination by @bleskes in #16909
bump out-of-tree extensions to v1.2.2 by @Tmonster in #16913
Allow SQL prepared statements to be rebound by @NiclasHaderer in #16820
Fix #16959: binding constraints should not modify the original constraints \
by @Mytherin in #16971
Add back manylinux extensions [on v1.2-histrionicus] AND bump extensions by \
@carlopi in #16976
Skip TPC-DS Q67 on DOUBLE by @Mytherin in #16987
Re-enable iceberg by @carlopi in #16992
Try enabling and bump delta by @Maxxen in #16990
Backport @szarnyasg's 16999 by @carlopi in #17013
1.2.1:
This is a bug fix release for various issues discovered after we released 1.2.0. \
There are no new major features, just bug fixes. Database files created by \
DuckDB versions all the way back to v0.9.* can be read by this version.
What's Changed
[Dev] MultiFileReader fix InternalError in CreateFilterMap by @Tishj in #16114
[bug-fix] Avoid throwing in catch block for failed commits by @Vegetable26 \
in #15903
Issue #16098: ValidEnd Parallel Vectorisation by @hawkfish in #16140
Adding an extension option shouldn't delete a set value and promote \
unrecognized options by @bleskes in #15919
Parquet writer: Re-implement GetRowSize for Strings by @Mytherin in #16178
Fix #16157: correctly get the first row when reading hive partitions from a \
dictionary vector by @Mytherin in #16180
Fix #16122: bind default values in a sub-binder to avoid modifying the \
catalog search path of the current binder by @Mytherin in #16181
Fix #16134: when a catalog/schema/table has the same name, we prefer to \
suggest the table name by @Mytherin in #16189
Ensure MergeCollectionTask has a writer by @ywelsch in #16207
Backport #16115 by @NiclasHaderer in #16227
Deleted copy constructor of pending query by @NiclasHaderer in #16242
Correctly report errors caused by get_database in C extensions by @mlafeldt \
in #16253
use random seeds for bernoulli sample when parallel is enabled by @Tmonster \
in #16223
Parquet Reader: avoid caching the compressed buffer in the ColumnReader by \
@Mytherin in #16263
Fix #16260: correctly handle parameters in getvariable by @Mytherin in #16264
Avoid calling SetFilterAlwaysTrue multiple times in RowGroup::CheckZonemap \
by @Mytherin in #16269
[Fix] Scanning from normal leaf to nested leaf by @taniabogatsch in #16270
Fix #16231: refer to order by condition in ARRAY(SUBQUERY) by alias instead \
of by index by @Mytherin in #16272
Fix #16257 by @lnkuiper in #16275
AFL Tests for the CSV reader by @pdet in #16280
Issue #16250: Window Range Performance by @hawkfish in #16276
Fix #16278: late materialization should not trigger on very large limits, \
and it should never trigger on limits without offsets when \
preserve_insertion_order = false by @Mytherin in #16282
Overflow strings allocations: avoid rounding up memory allocated per \
overflow string - when reading "small" overflow strings place them \
directly into the vector instead by @Mytherin in #16283
Use ordered map to preserve expressions order by @Damon07 in #16111
[Dev] register_filesystem stubs, use fsspec.AbstractFileSystem, not str by \
@Tishj in #16266
[Python Dev] Fix crash with empty args for isin | Fix transformation for \
isnotin by @Tishj in #16271
Fix issue related to hang when all candidates are eliminated in refinement \
by @pdet in #16288
[Fix] Early-out on CREATE INDEX (IF NOT EXISTS) by @taniabogatsch in #16093
[Python] Fix the reverse binary expressions in the Expression API by @Tishj \
in #16300
Bugfixes by @lnkuiper in #16244
[Fix] MinGW bundle static libs by @taniabogatsch in #16292
Fix heap buffer oveflow sampling by @Tmonster in #16279
Expose STRING_LITERAL in C API by @taniabogatsch in #16293
Allow accessing profiler query tree under lock by @ywelsch in #16314
bump extensions by @Maxxen in #16313
Inline virtual list lambda bind functions by @Maxxen in #16327
Update shell.cpp to fix #16333 by @teaguesterling in #16335
Add the suggestion to verify the nullstring as part of the cast error \
message by @pdet in #16336
Take NULLs into account for DELTA_BINARY_PACKED by @lnkuiper in #16317
PhysicalTableScan: Adapt to allow async behaviour by @carlopi in #16310
Allow querying attached catalog from detached catalog by @jeewonhh in #16289
Reduce minimum expected memory usage in RadixPartitionedHashTable by \
@lnkuiper in #16332
Backport ebb4dcc to v1.2-, adding missing include by @carlopi in #16369
Excecption load on mismatched ABI: Use '%d' to print ABI type by @carlopi in \
#16367
Aggregation: For dictionaries without an id - use the correct threshold to \
bail-out on using the dictionary by @Mytherin in #16364
Bump excel to the same version distributed on core repository by @carlopi in \
#16375
Accept valid dialects with escape set into the refinement phase by @pdet in \
#16387
Push the correct casts for values of different types in (X, Y) IN (SELECT X, \
Y) by @Mytherin in #16392
Add support for autoload and autoinstall for ui extension by @carlopi in #16393
Add twine_upload option to Python.yml to trigger upload by @carlopi in #16410
Only select options that generate more columns with null_padding, if they at \
least hold 50% of consistency by @pdet in #16404
Use checkpoint bind in DuckTableEntry::Copy to avoid re-validating default \
values (and potentially causing issues during WAL replay) by @Mytherin in #16398
Rename DUCKDB_API to DUCKDB_C_API for duckdb.h by @Mytherin in #16397
Issue #16407: Try_Strptime Invalid TimeZone by @hawkfish in #16416
Internal #4303: Windowed DISTINCT Leaks by @hawkfish in #16417
Internal #4258: MODE Spooling Stability by @hawkfish in #16415
Fix PyPi upload also for branches, when twine_upload is provided by @carlopi \
in #16421
[Fix] Throw constraint violation for FK constraint checking by @taniabogat \
Add storage and serialization version for v1.2.1 by @Flogex in #16403
Update flaky return_files.test by @jeewonhh in #16432
Add python version to duckdb_api by @guenp in #15599
Do not accept null values in lists for column parameters by @pdetigning \
using azure by @hannes in #16444
CSV small code Improvements + initialising boolean variable. by @pdet in #16454
[Python Dev] Make pandas not required in a couple places, check if it's \
installed in others by @Tishj in #16414
fix passinger in #16480
[Python Dev] pyproject.toml should not use oldest-supported-numpy anymore by \
@Tishj in #16486
[tests] Multiple FORMAT in copy, only last one matters by @carlopi in #16493
Bump postgres_scanner and fts extensions by @lnkuiper in #16492
bump sqlsmith extension tag by @Tmonster in #16488
[BugFix]: Swap join children, not left and right set by @Tmonster in #16487
[tests] Add allow_unsigned_extensions require by @carlopi in #16499
Provide callback when tasks are starting / stopping by @ywelsch in #16451
CodeQuality: ubuntu-20 to ubuntu-22, lock black to version 24 and trick \
clang_format detection by @carlopi in #16513
Move from ubuntu-20:04 to ubuntu-22:04, part I by @carlopi in #16510
[chore] Build Linux releases also on PRs AND ubuntu-20 to 22 by @carlopi in \
#16506
Move from ubuntu-20:04 to ubuntu-22:04, part II by @carlopi in #16514
bump spatial and excel for v1.2 by @Maxxen in #16504
CI Fixes after upgrade to ubuntu 22 by @Mytherin in #16516
LinuxRelease.yml: Pass down override git describe by @carlopi in #16521
bump spatial again by @Maxxen in #16518
|
| 2025-02-26 16:42:51 by Ryo ONODERA | Files touched by this commit (4) | |
Log message:
databases/duckdb: Update to 1.2.0
Changelog:
1.2.0:
What's Changed
Optimise division by a constant at runtime for integer division by \
JAicewizard in 10348
Add cross join to Python Relational and PySpark API by khalidmammadov in 13519
Fix 13805: throw a more descriptive error message when an on-disk file is \
referenced using a replacement scan for an unsupported file format by Mytherin \
in 13871
Make sampling accept parameters at the parser/transformer layer by Mytherin \
in 13903
Fix 13867: use 64-bit random numbers to generate random numbers for random() \
by Mytherin in 13920
Fix 13769: when binding views, always first search in the schema that the \
view is defined in by Mytherin in 13921
Rework table bindings to be components (catalog, schema, table) instead of \
flat strings by Mytherin in 14017
Add auto-loadable extension settings to duckdb_config_count and \
duckdb_get_config_flag by Mytherin in 14021
Fix 10961 - in the HAVING clause - in case of column name conflicts, bind to \
aliases instead of to ungrouped columns by Mytherin in 14023
Enable filter pushdown through Logical Unnest by Tmonster in 14008
Allow duplicate table aliases in the table binder by Mytherin in 14035
Unify DESCRIBE [query] and DESCRIBE [table] by Mytherin in 14039
Support qualified identifiers in the EXCLUDE clause by Mytherin in 14043
Add SMALLER_BINARY flag to reduce binary size by Mytherin in 14057
Smaller Binary: remove more templates from arg_min_max by Mytherin in 14071
Unify entropy and mode aggregates - and skip specialized implementations for \
entropy with smaller binary by Mytherin in 14080
[Python] Add set_default_connection to the duckdb module by Tishj in 13442
Provide workaround for prefetching parquet files with incorrect page offsets \
by samansmink in 13697
Move core_functions to a separate extension by Mytherin in 14149
PySpark df.drop() to support expressions by khalidmammadov in 14059
add some RealNest benchmarks by hmeriann in 13345
feed table function into multifilereader initialization by samansmink in 14112
[Dev] Fix an issue causing ExecuteTask to do much more work than intended by \
Tishj in 14034
Overhaul Parquet dictionary handling by hannes in 14194
[Feature] Allow passing the catalog (database name) to appender by \
taniabogatsch in 13692
Add Taxi Dataset Benchmark by pdet in 14197
Feature 3036: Window Spooling by hawkfish in 14181
Small C Extension API changes by samansmink in 13987
Add HTML and Graphviz support for explain analyze by abramk in 13942
Fix 13064: offer more suggestions with same score by Damon07 in 14048
New Algorithm to find a new line on parallel execution by pdet in 14260
Making client context lock optional for relation binding by pdet in 14093
[Feature] Allow passing the catalog during C API appender creation by \
taniabogatsch in 14256
Make test random output ordered by Damon07 in 14267
Skip test_window_distinct by Mytherin in 14309
Taxi Benchmark by pdet in 14301
Switch to shared pointer for multfilelists by samansmink in 14291
Push 14298 to feature branch by flashmouse in 14311
Implement PullUp Empty Results optimizer by Tmonster in 13524
[Export/Import] Use the DependencyManager to (stable) sort the entries \
before export by Tishj in 14196
Partitioning-Aware Aggregation and Partitioning-Aware Infrastructure by \
Mytherin in 14329
Add df.unionByName to PySpark API by khalidmammadov in 14063
Or filter pushdown into zone maps by Tmonster in 14313
Get the current setting in the database file opener by Mytherin in 14361
[Feature + Fix] Support ALTER TABLE tbl ALTER col TYPE USING and fix null \
handling in struct_insert by taniabogatsch in 14359
[C API] Add table_description_create_ext and \
table_description_get_column_name by taniabogatsch in 14285
Move _rtools platform to be equivalent to _mingw by carlopi in 14368
Fix for accidental like skip in the CSV Buffer by pdet in 14380
Table locks - always grab table locks through the transaction interface by \
Mytherin in 14379
Implementing array_slice and [] for BLOB by hannes in 14358
Rework settings handling and implement auto-generation for new ones by \
Mytherin in 14383
Rework settings handling and implement auto-generation for new ones by \
chrisiou in 14018
Arrow list buffer - suggest setting arrow_large_buffer_size to true when \
regular list buffer size is exceeded by Mytherin in 14384
Fix incorrect merge conflict resolution in workflow file by Mytherin in 14390
Update Parquet Thrift to latest version by hannes in 14258
Reformat list functions by c-herrewijn in 14372
Tidy Check to do complete run also on feature by carlopi in 14394
[Python] Use an ArrowQueryResult in FetchArrowTable when possible. by Tishj \
in 14319
Make mysql_scanner auto-loadable, and add mysql/postgres secrets by Mytherin \
in 14392
Improvement the speed of table sample systems by continue-revolution in 12631
Support defining column names in CTAS by douenergy in 14327
Fix pointer indirection in pyrelation.cpp by carlopi in 14403
Fix idx_t to int64_t implicit conversion flagged by clang-tidy by carlopi in \
14402
Storage: make ROW_Gp-N: Rework to use heap of sort keys by Mytherin in 14424
reformat string functions by c-herrewijn in 14400
Prefix Aliases in SQL by hannes in 14436
[Dev] Optimize ValidityMask when reading from a ColumnDataCollection by \
Tishj in 14416amically generated join filters through UNION, UNNEST and \
AGGREGATE by Mytherin in 14453
Try auto-casting for mismatching data chunks in the Appender API by \
taniabogatsch in 14433
Implement DELTA_BINARY_PACKED compression in Parquet writer by om C to C++ \
by Mytherin in 14473
Fixing an issue with parquet dictionary reading by hannes in 14438
Strip down unused/unsupported options from the CLI by Mytherin in 14478
[PySpark] Add withColumns, withColumnsRenamed, cos, acos, any_valState by \
Mytherin in 14483
CLI Code Cleanup: Move rendering logic into separate Renderer classes by \
Mytherin in 14485
Reformat compressed materialization functions by c-herrewijn in 14470
Internal 3273: Shared Window Expressions by hawel Reading Validation by pdet \
in 14439
Avoid recompilations of duckdb when there are no actual changes by carlopi \
in 14176
Add -safe mode to shell which disables external access, and remove SQLite \
UDFs from the shell by Mytherin in 14509
[PySpark] Add functions covar_pop, covar_samp, call_functions, endswith, \
startswith, exp, factorial, log2, ln, degrees, radians, atan, atan2, tan, round, \
bround by binste in 14454
Reformat arithmetic operators by c-herrewijn in 14489
add attach with default tables by samansmink in 14118
Add duckdb_param_logical_type by Giorgi in 14515
Remove most BUILD_ options for extensions, using CORE_EXTENSIONS by carlopi \
in 14531
CLI: more code clean-up by Mytherin in 14551
Reformat nested and sequence functions by c-herrewijn in 14495
Parquet: Fixing selection vector calculation by hannes in 14558
CLI: Fix for .mode markdown rendering after refactor by Mytherin in 14569
Out-Of-Core Updates & Deletes by Mytherin in 14559
Manage enable_external_access at the FileSystem level, and add allowed_paths \
and allowed_directories option by Mytherin in 14568
feat(iejoin): use sort to replace binary search in iejoin by \
my-vegetable-has-exploded in 14507
Clean-up distinct statistics - add hashes cache add the Append and Vacuum \
layers, and remove unnecessary lock by Mytherin in 14578
[PySpark] Test Spark API with actual PySpark as backend by binste in 14526
Internal 3273: Shared Window Frames by hawkfish in 14544
Reformat aggregate functions by c-herrewijn in 14530
Expose threshold argument of Jaro-Winkler similarity by zmbc in 12079
No pushing filters below projections that cast to a lower logical type id by \
Tmonster in 13617
Implement left_projection_map for joins by lnkuiper in 13729
remove superfluous comment by c-herrewijn in 14586
[Dev] Make the regression_test_runner easier to replicate by Tishj in 14557
[PySpark] Add dataframe methods drop_duplicates, intersectAll, exceptAll, \
toArrow by binste in 14458
Internal 3381: Window Race Condition by hawkfish in 14599
Rework generated EnumUtil code by Mytherin in 14391
Force aggregate state to be trivially_destructible, unless \
AggregateDestructorType::LEGACY is used by Mytherin in 14615
AWS - remove expected error message by Mytherin in 14633
Temp directory compression by lnkuiper in 14465
Add support for SELECT * RENAME by Mytherin in 14650
[PySpark] Add autocompletion for column names to dataframes by binste in 14577
Force aggregate state to be is_trivially_move_constructible by lnkuiper in 14640
Correctly render EXPLAIN EXECUTE - use op.GetChildren() instead of \
hard-coding special cases by Mytherin in 14651
Buffer Manager - Make DestroyBufferUpon atomic by Mytherin in 14656
proposed enhancements to the query graphs by peterboncz in 14637
Sampling respects seed from random number generator if no seed is given. by \
Tmonster in 14374
Blockwise NL Join: Return control on every iteration in ExecuteInternal by \
Mytherin in 14658
feature(spark): add hex and unhex functions by spenrose in 14573
Support SELECT * LIKE '%col%' syntax by Mytherin in 14662
feature(spark): add base64 and unbase64 function by spenrose in 14561
Fix 14663: correctly propagate null values in list concat operator by \
Mytherin in 14675
ALTER TABLE ADD PRIMARY KEY by taniabogatsch in 14419
Merge feature into main by Mytherin in 14690
Support for CSV Encoding (UTF-16 and Latin-1) by pdet in 14560
Fix 14699 - Correctly handle SHOW TABLES in views by Mytherin in 14705
Fix 14701 - avoid flattening in-place in ColumnData Append method by \
Mytherin in 14708
Use TryCastAs instead of DefaultTryCastAs in comparison_simplification by \
Mytherin in 14711
Value interface & serialization clean-up by Mytherin in 14710
Fix various nightly CI issues by Mytherin in 14720
CLI: Add support for .thousand_sep and .decimal_sep by Mytherin in 14721
Propagate collations through functions in a generic manner by Mytherin in 14717
Add functions for handling null duckdb_values by Giorgi in 14687
adaptive filters should not reorder filters that can throw by Tmonster in 14672
[Python] Add LambdaExpression to the Python Expression API by Tishj in 14713
Add fallback for thread count if jemalloc cannot identify by lnkuiper in 14688
csv: parse escape character in unquoted fields by fanyang01 in 14464
[Python][Expression API] Add the between method on the Expression class by \
Tishj in 14726
[Attach][Macro] Fix issues identified with an attached macro by Tishj in 14715
Dont quote strings on csv files if quote='' by pdet in 14731
sqlite3_api_wrapper: avoid nullptr dereference by ProjectMutilation in 14748
Rework BlockHandle to no longer have friend classes, and rework \
ConvertToPersistent so it fails if there are active outstanding pins by Mytherin \
in 14746
Revert "CMake: Avoid dependency-inducing codegeneration of extension \
headers" by carlopi in 14723
[PySpark] Add more functions such as ascii, asin, btrim, char, corr, ... and \
fix differences in ordering of null values between PySpark and DuckDB by binste \
in 14738
Added list value getters duckdb_get_list_child and duckdb_get_list_size by \
prashanthellina in 14714
[Python][Expression API] Add collate to create a CollateExpression by Tishj \
in 14749
copy to operator still write schema for empty rows by wenjun93 in 14524
[Python] Use nullable dtypes in Pandas DataFrame creation when possible by \
Tishj in 14377
Update metrics generation script and include it in CI run by taniabogatsch \
in 14756
Add support for projection pushdown into struct fields by Mytherin in 14750
Optimistic writes: flush the last row group in all scenarios by Mytherin in 14759
Improve SqlStatement::ToString for UPDATE and DELETE statement to include \
alias of RETURNING clause by HarshLunagariya in 14765
Add JSON Logical Type metadata to parquet writer by niger-prequel in 14747
[Python] Add support for Expression to values to create a ValueRelation by \
Tishj in 14757
Add missing global options to Python's write_parquet by fr3fou in 14766
Add operator name to profiling output by ywelsch in 14744
Detect catalog changes on DROP IF EXISTS by ywelsch in 14742
Correctly deal with continued operation after reading a truncated WAL, and \
clean up WAL handling logic in storage manager by Mytherin in 14785
[Fix] Error message in transaction manager by taniabogatsch in 14788
Initialize the grouping sets when there is a group by all to enable filter \
pushdown by Tmonster in 14660
Merge feature into main again by Mytherin in 14793
[Python][Expression API] Add update to DuckDBPyRelation, accepting \
Expression objects | Add DefaultExpression by Tishj in 14780
Fix 14540: fix unnest rewriter by flashmouse in 14784
[PySpark] Add approxCountDistinct, add_months, and various array functions \
by binste in 14620
Add syntax highlighting support for errors in the CLI by Mytherin in 14799
Implement 14787: allow expressions in the aggregate clause of a PIVOT \
statement, as long as the aggregate clause only modifies the aggregate result \
and does not contain other columns by Mytherin in 14800
When repeatable is set, set ParallelSink to false by Tmonster in 14797
[Catalog] Fix issue related to uncaught problems during a COMMIT by Tishj in \
14150
[Upsert] Support non-distinct values in the inserted data by Tishj in 14293
Fix issue copying a TABLE that references a SEQUENCE by Tishj in 14693
fix duckdb_extension.h macros for C by samansmink in 14808
LTO CMake setting was not working anymore on MacOS, fixing that by carlopi \
in 14811
Add syntax highlighting support to the DuckBox query result by Mytherin in 14820
Avoiding unnecessary rebinding by samansmink in 14616
Support struct projection pushdown in Parquet files by Mytherin in 14839
Internal 3263: Window Distinct Deadlock by hawkfish in 14775
Issue 14737: DISTINCT ORDER Dependency by hawkfish in 14840
[Python][Dev] Skip test_pandas_selection on Python3.8 by Tishj in 14851
[Python][Dev] Fix issues with new/updated tests in the python sqllogictest \
implementation by Tishj in 14850
add function ends_with back by Damon07 in 14859
Require capacity in ValidityMask by Mytherin in 14846
Issue 11557: DECIMAL Downcast Rounding by hawkfish in 14860
Increase map inference threshold by lnkuiper in 14848
Output exception message on parse exception by ackxolotl in 14852
Use LogicalTypeId::Unknown instead of LogicalTypeId::SQLNULL for macro \
binding by lnkuiper in 14809
return InsertionOrderPreservingMap from TableFunction to_string by \
samansmink in 14835
Support default values when appending data chunks by taniabogatsch in 14733
[PySpark] Add a lot more functions incl. some regexp ones by binste in 14761
Added getters for enum and struct type values by prashanthellina in 14831
Fix write partition columns false by ykskb in 14871
Generate In-Clause filters from hash joins by Mytherin in 14864
Move FTS extension out-of-tree by lnkuiper in 14872
[C API] More tests and nits by taniabogatsch in 14758
Issue 14885: DATEPART Cache Bounds by hawkfish in 14891
Fix arrow table filters by Tmonster in 14893
[Python] Fix various issues uncovered by 12959 by Tishj in 13149
Remove some Snappy definitions by lnkuiper in 14897
[Fix] Binder exception when creating a foreign key on a view by \
taniabogatsch in 14882
[C API] Implement AddColumn and ClearColumns for the Appender by \
taniabogatsch in 14880
python: use PyUnicode_FromStringAndSize() by methane in 14895
Top-N: Improve performance with large heaps, and correctly call Reduce by \
Mytherin in 14900
Append to child column first in list column append by Mytherin in 14902
Update cardinality during limit pushdown by jeewonhh in 14901
Add struct_concat by Maxxen in 14853
[Compression] Add ZSTD compression by Tishj in 14514
Improve timestamp functionality by taniabogatsch in 14818
Fix 14833: split_part follow pg by flashmouse in 14875
C API: Add Value Relation constructor with RelationContextWrapper and \
ParsedExpression as argument by anshuldata in 14892
Issue 14734: Wrap Parquet TIMETZ by hawkfish in 14908
[Fix] release shared connection pointer before it goes out of scope by \
roj516 in 14926
[Fix] Nightly async build by taniabogatsch in 14913
[Tests] Re-enable test for vector verification run by taniabogatsch in 14911
Return timestamp with timezone in read_text/read_blob by Maxxen in 14925
Fix several CLI issues by Mytherin in 14929
improve ReadAheadBuffer::AddReadHead error message by stephaniewang526 in 14940
Skip Dynamic Join Ordering Algorithm if there are many relations by Tmonster \
in 14943
remove failing benchmark by hmeriann in 14945
Typo in csv UnterminatedQuotesError how_to_fix_it by bradleybuda in 14951
Pullup empty results through delim joins as well by Tmonster in 14920
Fix getting named parameter type information. by Giorgi in 14952
Fix casting long to int via explicit cast in parquet by carlopi in 14959
Fix script/regression/benchmark.py rework by carlopi in 14958
Explicit install of pkg-config broke, removing it by carlopi in 14965
Improve code generation of storage and serialization version infos by \
carlopi in 14947
C API support for non-standard timestamp values by jraymakers in 14954
Implement Logical Compaction in Hash Join Operator by YimingQiao in 14956
Disable row group size bytes default initialization by lnkuiper in 14974
[Swift.yml] Bump to macos-14, and switch simulation targets by carlopi in 14984
Use IOException for failed fstat calls by ywelsch in 14975
Logical Sample requires child to have separate join order optimization by \
Tmonster in 14969
Properly register successful dialect runs by pdet in 14977
Run containerized builds requiring deprecatd \
ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION only on main/feature by carlopi in 14998
Fuzzer 3297: Nth Value Indexing by hawkfish in 14997
[Arrow] Filter pushdown decimal fix by Tishj in 14995
Support multiple function descriptions by c-herrewijn in 14838
Join Filter Pushdown does not push down in filters when nulls are present by \
Tmonster in 14970
[Fix] Throw on invalid MAP input in Value::MAP by taniabogatsch in 14916
Rely on extension-ci-tools workflow to build linux_amd64_gcc4 extensions by \
carlopi in 14987
Rework Auto-Complete To Work Based On PEG grammar by Mytherin in 15003
for-loop-erase bugfix in filter pushdown by peterboncz in 15008
Internal 861: Window Code Refactoring by hawkfish in 15007
Internal 3574: INTERVAL Normlisation Carries by hawkfish in 15009
[Arrow] Fix scan of an object providing the PyCapsuleInterface when \
projection pushdown is possible. by Tishj in 14993
[PySpark] - Add extra str functions to pyspark api by mariotaddeucci in 14921
[PySpark] - Add .isNull and .isNotNull methods to Column class by \
mariotaddeucci in 14960
DuckDB Arrow Non Canonical Extensions to use arrow.opaque by pdet in 15002
Autocomplete test fix by Mytherin in 15019
Add check_peg_parser to extension_entries by carlopi in 15021
Re-enable jemalloc on ARM by lnkuiper in 14810
Dynamically decide whether to do a Perfect Hash Join by lnkuiper in 14971
No salt for Android by lnkuiper in 14923
Fixup linux_arm64 extension builds by carlopi in 15016
Issue 14834: INTERVAL Collations by hawkfish in 15022
SUM(x + C) rewrite by Mytherin in 15017
Spell NULL with uppercase in configuration description and comments by \
szarnyasg in 15006
Force download doesn't require to do a head request by pdet in 14979
CSV Reader - 4 byte delimiters by pdet in 14670
More regression tests by lnkuiper in 14973
[PySpark] Add more functions such as slice, split, standard deviations, etc. \
by binste in 14863
Fix extension entries by Mytherin in 15027
Speed up scans of RLE compressed data by Mytherin in 15023
Speed up scans of Uncompressed strings by Mytherin in 15024
Internal 3583: INGNORE NULLS Race by hawkfish in 15032
[Regression.yml] Add icu, needed for external regression tests by carlopi in \
15044
Fix internal error of list_zip with only truncate argument provided by \
Damon07 in 15039
Avoid sum rewrite for hugeint/uhugeint since it could introduce overflow \
errors by Mytherin in 15040
BarScalarFunction needs to keep track of width != string.size() by carlopi \
in 15041
Add SUM(BOOL) overload by Mytherin in 15042
Add virtual callback to get dependency manager to the catalog by Mytherin in \
15043
Flip OR filter comparison if constant is on the other side by Mytherin in 15045
Fix 15010: in map cast only access validity when child elements were not \
fully converted by Mytherin in 15046
Various fixes for vector size = 2 CI by Mytherin in 15047
Add require ram to test runner, and use to limit distinct_grouping_tpch.test \
by Mytherin in 15048
[pystubs] Fix type of proto parameter in from_substrait methods. by \
ingomueller-net in 15004
CLI: Add -f [FILE] argument that allows execution of a file by Mytherin in 15050
max_temp_directory_size - print "90% of available disk space" as \
value if temp directory is not initialized by Mytherin in 15057
Interrupt query on error in ClientContext::Query by Mytherin in 15058
Turn count_if into an actual aggregate function by Mytherin in 15061
CLI: Add .safe_mode as a dot command as well by Mytherin in 15064
Pushdown inequality filtersy Mytherin in 15059
Restore support for DEBUG_STACKTRACE by carlopi in 15053
Shell: Provide a summary of numbers if we are rendering only a single row by \
Mytherin in 15031
Issue 15067: Postgres Age Compatibility by hawkfish in 15070
in quoted values. by pdet in 15018
IEJoin GetProgress: Normalize to 0-100 by carlopi in 15081
Avoid building for Python 3.7 on Windows by carlopi in 15085
Allow inputting a base hash in Regression workflow by lnkuiper in 15082
Topctly match only Sum aggregations in sum rewriter by Mytherin in 15088
new answers for some JOIN benchmarks by hmeriann in 15090
Ensure checkpoint tasks complete on IO exceptions by ywelsch in 15089
Internal 3615: Quantile Cursor Allocatin in 15303
remove conditional around fsync in single_file_block_manager by jkub in 15306
Move away from upload-artifactsv3 / download-artifactsv3 by carlopi in 15309
Fix update_extensions_ci test by carlopi in 15310
Addressing over-eager constraint checking with delete indexes by \
taniabogatsch in 15092
Fix internal issue 3740 by hannes in 15320
EXPLAIN/EXPLAIN ANALYZE - limit max lines of each extra info element, \
instead of truncating the entire node by Mytherin in 15317
Minor nightly test fixes by Mytherin in 15318
Bump Extension C API to stable by samansmink in 14992
Pass down DUCKDB_EXTENSION_SIGNING_PK as env by carlopi in 15324
Bump to latest sqlsmith and re-enable wasm by carlopi in 15323
Skipping lookups in GroupedAggregateHashTable if (almost) everything is \
unique by lnkuiper in 15321
Add automatic sampling regression fix 2 by Tmonster in 14914
[Dev] Fix Roaring compression bug on appending small vectors by Tishj in 15326
Fix JSON reader hang by lnkuiper in 15328
[Dev] Clean up Dictionary compression code by Tishj in 15300
Adjustments on test to bypass sniffing limitation on vector_size by pdet in 15330
Enable stack traces by default, split into getting the frame pointers and \
resolve symbols only when the error is finalized, and add support for demangling \
by Mytherin in 15337
Use correct element rename_list_el in grammar by Mytherin in 15339
Unified use of constant MainHeader: FLAG_COUNT by guoxiangCN in 15338
Append default to appender by Giorgi in 15121
add core functions make_timestamp_ns(nanos) and epoch_ns(timestamp_ts) by \
andreimatei in 14930
feat: support create_on_conflict in create_table_relation by scgkiran in 15245
Fix error message checking in test concurrent index by Mytherin in 15340
CI: Use mirror for Spark binaries by szarnyasg in 15372
Fix skip CSV Rejects test by pdet in 15359
Vectorize lookups in GroupedAggregateHashTable by lnkuiper in 15368
Bump azure and remove patches by carlopi in 15382
Fix conditional jump or move depends on uninitialised value(s) by pdet in 15367
Start encapsulating BaseExpression by Maxxen in 15360
[Python] Allow use of DuckDBPyType as child objects in implicit conversions \
by Tishj in 15346
[Dev] Made reference<CompressionFunction> function private in \
ColumnSegment by Tishj in 15347
[Dev] Fix erroneous assert in ZSTD scan for LogicalTypeId::VARCHAR by Tishj \
in 15357
[Dev] Reset to the vector cache so the vectors are clean for the scan by \
Tishj in 15383
Fix tests not to use compatibility version latest by carlopi in 15361
Fix Test introduced by new sampling by Tmonster in 15378
Feature 12699: RANK Secondary Sorts by hawkfish in 15331
[Fix] Uninitialised values in list_reverse by taniabogatsch in 15387
[Dev] Check in insert if the InsertionOrderPreservingMap contains the key, \
do nothing in that case by Tishj in 15385
AFL++ Fuzzer Tests and Fixes by pdet in 15329
Fix RelationStatisticsHelper to estimate table filters correctly by Tmonster \
in 15308
[PySpark] - Add broadcast function by mariotaddeucci in 15037
feat: refactor getting tie_break_offset in SelectBestMatch by \
stephaniewang526 in 15235
Added dashes to test case csv_buffer_size_rejects.test_slow by hannes in 15398
[Dev] Split last part of ColumnDataCheckpointer::Checkpoint into \
FinalizeCheckpoint by Tishj in 15388
Fix JSON reader hang found by fuzzer by lnkuiper in 15397
Better partition selection for external hash joins by lnkuiper in 15389
fix arm extensions ci by samansmink in 15400
Feature 12699: ROW_NUMBER Secondary Sorts by hawkfish in 15403
Improve hash combining by lnkuiper in 15408
allow multifilereaders to delete entire chunks in FinalizeChunk by \
samansmink in 15401
Fix issue 14659 by pdet in 15411
Fix for issue 14648 by pdet in 15409
Re-enable some tests, removing mode skip or moving it later by carlopi in 15488
[Fix] Adjust reclaim space test to smaller block size nightly by \
taniabogatsch in 15414
Feature 12699: CUME_DIST Secondary Sorts by hawkfish in 15413
Fix issue with cleanup of buffers when reading same file multiple times by \
pdet in 15358
[Fix] Track correct allocation size of evicted memory by taniabogatsch in 15433
Fix internal issue 3813 by lnkuiper in 15427
Exploit RFC_4180 to be more strict with newline settings by pdet in 15426
Adds comment to Python Object + small adjustment do sniffer with comment \
detection. by pdet in 15425
Fix more nightly test errors due to sampling by Tmonster in 15423
Type mismatch set operation by Tmonster in 15422
Making the names option of CSV Files more restrictive when reading one file. \
by pdet in 15431
[Python][Dev] Lock mypy at 1.13 by Tishj in 15448
Fix InFilter::ToString, visible via EXPLAIN ANALYZE for example by carlopi \
in 15487
Mention configuration option that avoids total string size error in error \
message by soerenwolfers in 15489
Fix the seed of RandomLocalState to be 64bit instead of 32bits by carlopi in \
15482
Fix ADBC Leak when reusing statements by pdet in 15475
chore: Add physical type translations for new timestamp types by krlmlr in 15472
[Dev] Slight cleanup of assert.hpp by Tishj in 15453
Retain join partition order by lnkuiper in 15460
Use system threads for parallelism on read_csv if reading from pipe by pdet \
in 15461
C API header generation for Go bindings by taniabogatsch in 14944
Move InitSegment into roaring namespace (nit) by arjenpdevries in 15495
chore: Add header for g++15 compatibility by krlmlr in 15509
Functions can throw errors by Tmonster in 15166
Improve candidate error message and relax constraint of rfc_4180 = false on \
quotes by pdet in 15371
Implement Union By Name on read csv relation by pdet in 15452
Add behaviour to remove unescaped quotes of unquoted values by pdet in 15454
[CSV Sniffer] If a column with Time/Date/Timestamp values encounter any \
other value, immediately go to VARCHAR by pdet in 15494
Introduce 2 new platforms: musllinux_arm64 and musllinux_amd64 by carlopi in \
15429
15128: failed to bind column reference for function under unnest. by \
Tmonster in 15421
Setting descrialise Secondary Orderings by hawkfish in 15541
Throw IO exception on 1.1.3 database file with incorrect dependency order by \
taniabogatsch in 15568
Use ISNULL in conjunction or filters by Tmonster in 15529
Avoid fast fail: change defaults by tqml in 15474
Implicit STRUCT to STRUCT cast for mismatching member names by taniabogatsch \
in 15477
make test always fail in case of internal exception by c-herrewijn in 15569
CI: Bump container for Android build by szarnyasg in 15[Dev] \
ColumnDataCheckpointer can now checkpoint column data and validity data together \
by Tishj in 15566
Feature 12699: Secondary Sort Framing by hawkfish in 15523
[Test] More STRUCT cast tests by taniabogatsch in 15578
Making RFC4180=T DatabaseInstance's destructor: avoid throwing (and not \
cleaning up) by carlopi in 15707
Bugfixes by lnkuiper in 15704
Remove iceberg, again by carlopi in 15716
Allow shift-tab to be used to revert auto-complete suggestion, and implement \
SHOW [table] auto-completion by Mytherin in 15708
[Dev] Fix alignment issue in Roaring compression method by Tishj in 15711
Minor fixes by Mytherin in 15715
Move the DatabaseCacheEntry into the DBConfig, and set it before the \
constructor is called by Mytherin in 15714
Patching comparison operators in ICU to actually return bool by hannes in 15700
Preserve stack trace information when re-throwing by NiclasHaderer in 15709
[MultiFileReader] Extend support for column mapping from local -> global \
column by Tishj in 15446
Fix Arrow extension type Locks by pdet in 15705
Dont encode + on URL by pdet in 15693
Print an error when using "duckdb -f [file]" on a file that does \
not exist by Mytherin in 15718
Implement parquet_version parameter for Parquet writer by lnkuiper in 15684
[Testing] Temporarily skip tests by taniabogatsch in 15727
Add NATIVE_ARCH option to compile using -march=native, and in the CLI time \
queries that are send through "-c" by Mytherin in 15726
Remove httpfs patch by lnkuiper in 15729
Fix 15659: VARCHAR parameters now count as STRING_LITERAL again by Mytherin \
in 15724
Parquet reader: fix for filter on file_row_number column by Mytherin in 15736
Scan validity from dictionary vectors directly, and skip scanning validity \
when we encounter a dictionary vector by Mytherin in 15737
Make entries field non-nullable for Arrow map type by samansmink in 15733
Properly set external flag again in RadixPartitionedHashTable by lnkuiper in \
15728
Storage version 65 by carlopi in 15702
Enable index scan for dynamic IN filter by taniabogatsch in 15665
Ignore pushes to version branches by Mytherin in 15743
Move changes in v1.2 to main by Mytherin in 15744
Initialize create_index_info.catalog by philippmd in 15738
Feature 15717: Window GROUPS by hawkfish in 15739
Fetch only required columns in physical delete by taniabogatsch in 15746
Add duckdb secret types function by samansmink in 15564
First round of extension bumps by Maxxen in 15655
Move core_functions to use unity builds by Mytherin in 15753
Add disabled_compression_methods setting that can be used to disable certain \
compression methods by Mytherin in 15754
Add support for deserializing a list of SetOperations in the \
SetOperationNode by Mytherin in 15755
Feature 15717: Window GROUPS by hawkfish in 15761
Check for mark join indexes in aggregate and group by by Tmonster in 15691
Default end of binding to varchar and not bool in CSV Reader by pdet in 15747
If arrow extension is not registered, use format information instead of \
failing by pdet in 15749
Merge 1.2 into main by Mytherin in 15769
Fix CI for Linux Release Building by hannes in 15748
Merge changes in main into v1.2 by Mytherin in 15770
When loading LogicalDependency from a database file or WAL file, modify the \
catalog to the catalog that we are loading into by Mytherin in 15767
Fix minor DuckDB-Wasm problem with stacktraces, that would be shown twice by \
carlopi in 15765
Move the instance cache entry when configuring by Mytherin in 15768
nitpick: Sequence Scan -> Sequential Scan by Mytherin in 15772
Bundle MingW static library with the default extension configuration by \
taniabogatsch in 15774
[Fix] Fix truncate + FK internal exception and another index bug by \
taniabogatsch in 15771
Switch logging to macros by samansmink in 15751
Add back Iceberg extension by carlopi in 15780
Internal 4002: SQLite EXCLUDE Tests by hawkfish in 15785
Skip 3 tests, to be reviewed on a side by carlopi in 15790
Add MD to autoload list by Mytherin in 15797
Connection manager: make count available without a lock by keeping track of \
it with an atomic by Mytherin in 15798
Add STORAGE_VERSION option that allows you to specify the target storage \
version when serializing a database by Mytherin in 15794
Fix some memory/storage issues in CI by lnkuiper in 15795
Fix map_extract backwards compatability by Maxxen in 15799
Fixes for vsize=2 tests by Mytherin in 15809
Fix tests for storage 65 by carlopi in 15807
Enable tests using no_alternative_verify by ywelsch in 15806
V1.2 histrionicus by Mytherin in 15812
Fix dependency conflict in PK FK benchmark by taniabogatsch in 15800
Remove shuffle from sampling by Tmonster in 15703
bump inet by Maxxen in 15804
Fix map_inference_threshold issue in JSON reader by lnkuiper in 15802
[CI] Invert operations for Linux CLI: first deploy, then test by carlopi in 15820
Fixup shell & autocomplete versioning information by carlopi in 15823
Skip end of \
test/sql/storage/parallel/insert_many_compressible_batches.test_slow by carlopi \
in 15814
Attempted parquet warning fix by Mytherin in 15827
Issue 15758: Streaming LEAD Buffering by hawkfish in 15834
Removing all core code and CI related to the substrait extension by pdet in 15810
CSV AFL Tests by pdet in 15805
improve error messages for mismatching versions of extensions by samansmink \
in 15829
dbgen: correctly join threads in case an error is thrown while generating \
data in parallel by Mytherin in 15840
Do not change type of empty files, if the types were manually set by pdet in \
15841
Fix 15760 - when a SQL value function conflicts with an alias in the WHERE \
clause, prefer the alias by Mytherin in 15842
Fix 15570: preserve alias when using bind_replace in table functions by \
Mytherin in 15843
Fix CAPI chunk tests by pdet in 15846
fix: Fix compiler warning for uninitialized access by krlmlr in 15849
Relax RFC_4180=False a bit more flexible by pdet in 15832
More lenient test limits by Mytherin in 15845
bump delta, remove patches by samansmink in 15824
enable autoloading for iceberg and delta for storage by samansmink in 15822
Fix get_current_time, today, current_date backwards compatibility by Maxxen \
in 15803
Reset buffer before allocating a new one in ResizableBuffer by lnkuiper in 15838
V1.2 histrionicus by Mytherin in 15851
[tpch] dbgen: Avoid throwing interrupt that can't be caught by carlopi in 15856
Add CI run testing also slow tests on PRs by carlopi in 15854
More memory for external aggregate test by Mytherin in 15861
Fixes for nightly tests related to the CSV Parser by pdet in 15855
Fix latest storage tests CI by Mytherin in 15863
Fix duckdb_extensions() listing by carlopi in 15858
Use const T& and T instead of const T&& and T&& in \
(de)serializer by Mytherin in 15866
Make tests more lenient for smaller block sizes by Mytherin in 15872
Remove default in MultiFileReaderColumnDefinition constructor by Mytherin in \
15871
Fix spurious test/sql/copy/partitioned/partitioned_write_tpch.test_slow:53 \
error by pdet in 15869
BindLogicalType should return a new type, instead of modifying an existing \
type in-place by Mytherin in 15868
V1.2 histrionicus by Mytherin in 15875
Issue 15877: CUME_DIST Moving Frame by hawkfish in 15878
Nightly CI fixes by Mytherin in 15885
Disable the RealNest benchmark nightly by hmeriann in 15839
disable iceberg tests by samansmink in 15883
[Linux CI] Remove examples, already tested as part of OSX Release by carlopi \
in 15879
Fix fuzzer issue found by the DuckFuzzer by pdet in 15886
Avoid unnecessarily reading the string dictionary size when scanning \
uncompressed strings by Mytherin in 15887
GCC-4.8 fixes by Mytherin in 15884
Several nightly CI fixes by Mytherin in 15889
Merge main into v1.2 by Mytherin in 15895
When Deserializing, Sample Selection Vectors should be initialized to \
FIXED_SAMPLE_SIZE by Tmonster in 15890
Faster re-builds by hannes in 15891
Add missing ExpressionType::COMPARE_NOTEQUAL no arrow pushdown by pdet in 15892
Fix race/deadlock in FixedSizebuffer::Get() by Maxxen in 15893
Call ProcessError also for PendingQueries by carlopi in 15899
Removed unused variable in LoggingContext by NiclasHaderer in 15898
CI: Handle 'fixed on nightly' label by szarnyasg in 15900
CheckMagicBytes: zero initialise buffer by carlopi in 15902
Rename RFC_4180 to STRICT_MODE. Change default to true. Use the same option \
in the sniffer as the parser. by pdet in 15896
Fix Arrow Type Registration on Extensions by pdet in 15901
V1.2 histrionicus by Mytherin in 15909
Use Arrow extension GetType() implementation when converting Arrow arrays by \
paleolimbot in 15813
|
| 2025-01-01 11:22:38 by Ryo ONODERA | Files touched by this commit (3) | |
Log message:
databases/duckdb: Update to 1.1.3
Changelog:
1.1.3:
This is a bug fix release for various issues discovered after we released
1.1.2. There are no new major features, just bug fixes. Database files created
by DuckDB versions all the way back to v0.9.* can be read by this version.
What's Changed
* [Adaptive Sniffer] In case files have only one row, be more permissive to
detect headers and types. by @pdet in #14174
* Increase bounds for test/sql/copy/file_size_bytes.test by @lnkuiper in #
14367
* Use table-level locking when acquiring shared locks by @ywelsch in #14370
* [Arrow] Fix scanning of BOOL columns when offsets are involved by @Tishj in
#14395
* avoid unnecessary file list materialization when pruning readers by
@samansmink in #14397
* Fixing type pushdown on the CSV Scanner by @pdet in #14399
* Issue #14398: Lead Shift Defaults by @hawkfish in #14409
* Escape should default to quoted by @pdet in #14418
* Sniff CSV rejects options and small sniffer fix for ignore_errors by @pdet
in #14417
* Fix #14430 - throw an error when reading corrupt statistics in the perfect
hash aggregate by @Mytherin in #14442
* Use corrent container to produce BinderErrors by @carlopi in #14437
* Rework list_concat to accept a variable number of arguments similar to
string concat by @Mytherin in #14443
* SingleFileBlockManager::MarkBlockAsUsed - also erase from newly_freed_list
to ensure trim does not prune blocks that are in-use by @Mytherin in #14467
* acosh: Change example to avoid returning NaN by @szarnyasg in #14477
* Don't move lvalue when inserting in order preserving map by @Maxxen in #
14492
* bump vss by @Maxxen in #14493
* Bug in percentage calculation in query_graph by @bjornasm in #14494
* fix: standardize usage of LogicalType::ROW_TYPE for
COLUMN_IDENTIFIER_ROW_ID by @rustyconover in #14480
* [Python][Dev] Fix up test to work with older version by @Tishj in #14505
* Avoid throwing on failure to open extensions's .info file (when force
installing) by @carlopi in #14272
* Python 3.7 tests are particularly brittle, we will keep building wheels but
avoid testing them by @carlopi in #14510
* Being more restrictive with the names option in the csv reader by @pdet in
#14466
* [Arrow] Fix issue where uninitialized memory was being read when scanning
empty lists by @Tishj in #14538
* Fix #14545 - pivot header must be defined in the grammar by @Mytherin in #
14556
* [Python][Arrow] Cast to py::bytes when dealing with BLOB in filter pushdown
by @Tishj in #14553
* [Dev] Include aliases for RETURNING list expressions in ToString by @Tishj
in #14533
* CI: Mirror 'reproduced' / 'under review' to the internal repository by
@szarnyasg in #14527
* Approx-Top K: Make aggregate state trivially destructible by @Mytherin in #
14571
* Don't pre-initialize hash vector in DistinctStatistics construction by
@abramk in #14570
* Fix query_graph tool for #14290 by @JasonPunyon in #14521
* Fix typos by @deining in #14579
* [Dev] Traverse the replace_list of StarExpression in
ParsedExpressionIterator::EnumerateChildren by @Tishj in #14535
* chore: Add EOL to source files by @krlmlr in #14583
* Issue template: Add Swift redirect by @szarnyasg in #14588
* Fix for underflow issue on number of rows in the CSV Reader by @pdet in #
14587
* Cas strong by @lnkuiper in #14592
* HTTPFS: HTTPException no longer inherits from IOException by @Mytherin in #
14585
* [bufferpool] Fix PurgeAgedBlocksInternal() evictions by @Vegetable26 in #
14446
* CI: Add bot for 'minimal reproducible example' by @szarnyasg in #14598
* CI: Fix and simplify 'needs reproducible example' labelling by @szarnyasg
in #14608
* CI: Fix and simplify 'needs reproducible example' labelling by @szarnyasg
in #14609
* Enable serialization of LogicalExport by @Mytherin in #14594
* Test fixes for new arrow release by @pdet in #14593
* CI: Fix labelling bot by @szarnyasg in #14611
* CI: Add repo name to labelling script by @szarnyasg in #14612
* Unexpected result comparing blob by @Tmonster in #14604
* Storage info update by @szarnyasg in #14371
* Fix #14600: use UUID to generate unique pivot enum names by @Mytherin in #
14622
* Fix #14601: avoid exporting entries in the temp or system schema by
@Mytherin in #14623
* Issue #14618: Year Day Year by @hawkfish in #14624
* Fix #14542 by @lnkuiper in #14610
* add index plan callback to IndexType by @Maxxen in #14511
* FIX: Discrepancy Between Count and Sum Queries in SQL by @Tmonster in #
14634
* Fix Windows Extensions CI by @Mytherin in #14643
* chore: Add qualification for brotli code by @krlmlr in #14628
* fix: Initialize atomic class member by @krlmlr in #14627
* Fix secret serialization issues by @samansmink in #14652
* Add serialization for bitstring_agg function by @ywelsch in #14654
* Force error on CSV Sniffer Failure by @lcostantino in #14661
* bump vss + spatial by @Maxxen in #14667
* Bump extensions: AWS, Delta, Iceberg, INET by @carlopi in #14669
* fix scoping problem with function argument by @Damon07 in #14666
|
| 2024-10-31 15:39:57 by Ryo ONODERA | Files touched by this commit (3) |
Log message:
databasea/duckdb: Update to 1.1.2
Changelog:
v1.1.2 Bugfix Release
This is a bug fix release for various issues discovered after we released
1.1.1. There are no new major features, just bug fixes. Database files created
by DuckDB versions all the way back to v0.9.* can be read by DuckDB v1.1.2.
What's Changed
* [CI] Re-enable ART zero initialisation verification by @taniabogatsch in #
14031
* Push filters instead of overwriting filters by @Tmonster in #14078
* Fix test by @Tmonster in #14079
* fix maximum_threads test inside containers by @wenjun93 in #14083
* Fix: remove is_probe_in_domain by @Light-City in #14084
* Add duckdb_extension.h to amalgamation release by @samansmink in #14086
* Bump minimum required cmake version by @abramk in #14089
* Fix parser error by removing alias by @taniabogatsch in #14090
* [Dev] Move EnumTypeInfoTemplated definition into a hpp file by @Tishj in #
14038
* Fix #14077: correctly reset next pointer when reconstructing new row group
segment tree after vacuum by @Mytherin in #14092
* Format CSV error messages by @szarnyasg in #14097
* Fix the answer file for tpcds q67 at sf100 by @Tmonster in #14096
* Add v1.1.1 to version_map.json by @Flogex in #14110
* CREATE TABLE now supports columns with ENUM[] types. by @Tishj in #14102
* fix parquet cardinality when first file is empty by @wenjun93 in #14058
* [Python Dev] Make sure the GIL is released when the connection+db are being
shut down by @Tishj in #14113
* Less salt by @lnkuiper in #14173
* remove redundant code by @flashmouse in #14172
* comparison of nested types returns true or false always (even with nulls)
by @Tmonster in #14094
* subtype DBInterface.Connection in julia client by @piever in #14193
* [Python] Fix a bug with python_scan_all_frames reaching the bottom of the
frame stack by @Tishj in #14183
* [Dev] Fix issue where the InsertStatement::ToString call destroyed the
alias of the ValuesList by @Tishj in #14171
* [Python] Fix issue related to scanning float64 dtype columns that contain a
mask by @Tishj in #14170
* Fix some warnings found while compiling duckdb-node by @carlopi in #13994
* fix minmax type info miss by @Damon07 in #14159
* fix: ArrowSchemaMetadata::GetOption to return empty string instead of
raising exception if key is not found. by @rustyconover in #14157
* Issue 14151: Fix conflicting defines on Windows hidden by cmake unity
builds by @zmajeed in #14154
* Issue 14189: Fix build when threads are disabled by @zmajeed in #14190
* Fix an uncaught error with a generated column containing a subquery by
@Tishj in #14198
* Add missing word in TableFunction comment by @JelteF in #14210
* add method to check whether julia connection is open by @piever in #14195
* Avoid schema changes with IF NOT EXISTS by @ywelsch in #14143
* Fix typos in code by @c8ef in #14243
* [Dev] Add the ExecutorException class, making use of the EXECUTOR
ExceptionType by @Tishj in #14231
* [Python] Don't allow construction of DuckDBPyType from empty Dict type by
@Tishj in #14221
* Fix #14232: fix deliminator optimizer by @flashmouse in #14238
* [CSV Reader] Also use figure-out-line code when ignoring errors. by @pdet
in #14184
* remove redundant Bit::SetBit by @flashmouse in #14226
* Fix #14212: mention correct query component when using literal in DISTINCT
ON by @Mytherin in #14255
* Removing overzealous check in Parquet by @hannes in #14268
* Update sqlsmith extension and patches by @Tmonster in #14270
* Support for duckdb.varint extension in Arrow. by @pdet in #14273
* Disable CSV ignore_errors benchmark by @pdet in #14277
* Only slice initialized vectors in
PhysicalHashAggregate::SinkDistinctGrouping by @lnkuiper in #14289
* Fix #14249: return NAN when dividened is 0 by @flashmouse in #14298
* Revert "Fix #14249: return NAN when dividened is 0" by @Mytherin \
in #14308
* fix macro name with the same function name in it which causing repeat?? by
@Damon07 in #14296
* Fixing issue with the sniffer on copy statetements by @pdet in #14295
* Json bugfixes by @lnkuiper in #14288
* [Bitstring] Add overload for bitstring to accept BIT as the type of the
first argument by @Tishj in #14247
* [Fix] Don't initialize reference, constant, and parameter children in
intermediate chunk by @taniabogatsch in #14254
* Profiling - correct settings per node type and minor renaming for clarity
by @taniabogatsch in #14290
* Fix extension size increase by @samansmink in #14185
* Add option to ignore GeoParquet, disable spatial autoloading when reading
GeoParquet by @Maxxen in #14297
* More defensive programming in RowVersionManager::CleanupAppend by @Mytherin
in #14317
* Change Makefile to correctly handle DISABLE_SANITIZER and DISABLE_UBSAN by
@JelteF in #14316
* [CSV Reader] Making escape not limited to only quotes by @pdet in #14314
* allow external cardinality information (e.g. from iceberg) by @peterboncz
in #14292
* [SecretManager] Fix deserialization of Value types in
KeyValueSecret::Deserialize by @Tishj in #14332
* Avoid throwing InternalException on reading secret by @carlopi in #14336
* delay the rewrite of a large IN-clause into a MarkJoin on remote
Filter-Scans by @peterboncz in #14266
* JSON reader - never generate maps if map_inference_threshold is -1 by
@Mytherin in #14348
* [Appender] Support appending to table with generated columns by @Tishj in #
14346
* Internal #3251: DateDiff Across Epoch by @hawkfish in #14338
* Bump azure and delta extensions commits by @carlopi in #14350
* Bump spatial to 3f94d52aa9f7d67b1a30e6cea642bbb790c04aa2 by @carlopi in #
14351
* Bump more extensions: iceberg, vss and sqlite_scanner by @carlopi in #14352
* Emit profiling info for extension operators by @Mytherin in #14355
v1.1.1 Bugfix Release
This is a bug fix release for various issues discovered after we released
1.1.0. There are no new major features, just bug fixes. Database files created
by DuckDB since v0.9.* can be read by DuckDB v1.1.1.
What's Changed
* [Python] Fix a crash related to handling of the f_locals by @Tishj in #
13821
* [Dev] Remove unnecessary parameter from BufferHandle constructor by @Tishj
in #13823
* When vacuuming, immediately checkpoint the vacuumed row groups instead of
scheduling a checkpoint task by @Mytherin in #13825
* Check for unquoted errors after finishing up a buffer. by @pdet in #13826
* Issue #13813: TIMETZ Uninvertible Casts by @hawkfish in #13820
* add cardinality for cross product and propositional join by @jeewonhh in #
13818
* Add requested_schema argument to PyCapsule interface by @WillAyd in #13802
* Throw at double/float cast to decimal if it does not fit by @pdet in #13745
* [Fix] C API - Correct type comparison in MAP value functions by
@taniabogatsch in #13844
* [C-API Dev] Fix up "Test DataChunk populate ListVector in C API" \
test by
@Tishj in #13839
* [Dev] Minor cleanup to BufferManager and BlockHandle API by @Tishj in #
13838
* Small fixes for prompt of sniff_csv by @pdet in #13843
* [BufferManager] Fix duckdb_memory() reporting wrong size for
temporary_storage_bytes by @Tishj in #13837
* Fix for internal error when using rejects tables and adding implicit cast
for boolean values. by @pdet in #13849
* [Fix ART] Correct prefix transformation by @taniabogatsch in #13858
* [Python] Fix issue causing an exception when creating a
duckdb.StarExpression without an exclude_list by @Tishj in #13881
* Fix issue with cgroups/slurm variables: skip if memory limit cannot be
parsed, and only run this on Linux by @Mytherin in #13879
* Explicit windows-2019 instead of windows-latest by @carlopi in #13883
* CI/Windows: Drop redundant package by @szarnyasg in #13874
* Preserve operator in BindWithCTE by @lnkuiper in #13873
* Update description of 'max_temp_directory_size' by @szarnyasg in #13724
* 13810 unnest cross join error by @Tmonster in #13878
* Tweak allocation purging by @lnkuiper in #13877
* Copy From Database - create a balanced UNION ALL tree instead of a
depth-first union all tree to avoid stack overflows by @Mytherin in #13889
* [Python] Fix issue related to the GIL when using execute with multiple
statements by @Tishj in #13893
* Fix #13880: correctly name http_proxy_password setting by @Mytherin in #
13890
* Fix #13872: duckdb_result_return_type is not deprecated, and group together
deprecated functions by @Mytherin in #13891
* [Python] Add python_scan_all_frames to opt-in to scanning all frames (< 1.1
behavior) by @Tishj in #13896
* Improve error on enums by @carlopi in #13885
* Handle extension ABI mismatches in a forward & backward compatible way by
@carlopi in #13894
* Fix #13824: min() max() varchar column use default collation by @flashmouse
in #13909
* Fix issue in casting 2 byte BIT -> BLOB by @Tishj in #13908
* add missing azure secret providers for autoloading by @samansmink in #13902
* Remove buffer_manager_allocate.patch and bump spatial by @carlopi in #13895
* [Python] Improve install_extension to support repository/repository_url and
version by @Tishj in #13876
* fix REGEX not supported anymore for valid queries (only statement error) #
2889 by @hmeriann in #13633
* [CI] Invert operations on OSX.yml, deploying nightly artifacts before test
by @carlopi in #13927
* [Python][Jupyter] Don't use ExplainFormat::HTML for explain('analyze') by
@Tishj in #13928
* Only bind to SQL value functions if there is no alias with this name
present we can bind to instead by @Mytherin in #13925
* Improve logic for remote extension install on Windows by @carlopi in #13929
* CI: Trigger actions for labeled discussions by @szarnyasg in #13937
* [Swift] Update README.md in Swift repo by @tcldr in #13955
* [Dev] Add exclusion for pybind11 internal _pybind11_conduit_v1_ method by
@Tishj in #13961
* Create a balanced union tree, also for export by @Mytherin in #13956
* Increment julia version by @Mytherin in #13966
* Fix #13585 - transform from or select first based on order specified by the
user by @Mytherin in #13959
* Fix Cross Product Cardinality by @jeewonhh in #13954
* Do not run the date/timestamp format sniffer if they are set by the user by
@pdet in #13960
* Modify create_art_varchar.benchmark so it passes weekly regressions by
@Tmonster in #13968
* Fix data race when writing GeoParquet by @Maxxen in #13962
* Check vector type in GetVectorScanType to avoid concurrent race when
updating validity by @Mytherin in #13965
* Parser Keyword Category Search by @pdet in #13875
* Escape quotes in FTS by @lnkuiper in #13917
* Fix #13941: fix error message in appender by @Mytherin in #13957
* fix: remove http prefix from proxy value when present by @dylanspag-lmco in
#13973
* Use defaults when serializing copy to file by @Mytherin in #13978
* Fix #13933: disable join filter pushdown when a join is performed over
collated columns by @Mytherin in #13958
* Fix partitions on wide tables by @piever in #13988
* [Fix] Throw exception for UNNEST in lambdas by @taniabogatsch in #13969
* Fixing some parquet issues found by fuzzing by @hannes in #13964
* fix julia partitions for streaming result by @piever in #14000
* More descriptive Parquet created_by with version and source hash by @hannes
in #13992
* Decimal downcast limit check by @pdet in #13922
* [C API] Add SQLNULL to the duckdb types by @taniabogatsch in #13999
* Fix crash in the shell caused by printing blobs that failed to cast by
@Maxxen in #13983
* [Binding] Always try binding with the schema of the UserType first if it's
set by @Tishj in #13995
* [Arrow] Only produce 'arrow.json' Extension types when
arrow_lossless_conversion is enabled. by @Tishj in #13989
* Bugfixes by @lnkuiper in #13982
* Disable swift linux tests by @Mytherin in #14019
* fix minor typos in comments of aggregate function tests by @era127 in #
14007
* [CSV Sniffer] Slight change of rules for dialect detection by @pdet in #
14013
* [Test Fix] Add noforcestorage to in-memory tests by @taniabogatsch in #
14016
* Fix #14020: fix off-by-one in RLE compression: avoid flushing when
last_seen_count == 0 which can happen if a column has exactly 2^16 (65535)
repeated values by @Mytherin in #14030
* Adds Julia support for scalar UDFs by @drizk1 in #14024
* Proper NULL handling in special json extraction functions by @lnkuiper in #
14032
* Fix #13993 - avoid disabling optimizers for SET VARIABLE by @Mytherin in #
14028
* [Arrow] Make unknown Arrow extensions throw at scan instead of bind by
@pdet in #14015
* Improve assertion macros by @c-herrewijn in #14033
* [Arrow] Move ArrowUtil to its own file by @Tishj in #13990
* [CSV Sniffer] Verify validity of header before value access by @pdet in #
14040
* Fix #14026: all TIMESTAMP_xx cannot cast to TIME directly by @flashmouse in
#14045
* Only merge distinct stats if both sides have distinct stats available by
@Mytherin in #14046
* Avoid http-redirect in README by @carlopi in #14029
* fix: make ArrowArrayWrapper::GetNextChunk() virtual by @rustyconover in #
14003
* Issue #13655: MEDIAN Even Tests by @hawkfish in #13722
* Fix #13934: use CreateSortKeyWithValidity to correctly handle NULL in all
calls to arg_max by @Mytherin in #14053
* Upgrade MySQL/Postgres extensions by @Mytherin in #14054
* [Union Reader] Early-out on readers of files that do not have data by @pdet
in #14050
* Issue #13899: AsOf Unrelated Pushdown by @hawkfish in #13975
* Feature #3128: 2024b Time Zones by @hawkfish in #14061
* bump spatial by @Maxxen in #14062
* Fixup StagedUpload invocation via workflow_call by @carlopi in #14065
* Skip polars test in 3.7 due to missing PanicException by @carlopi in #14066
* Add building, testing and distributing for Python 3.13 by @carlopi in #
14067
* bump sqlsmith and azure versions by @samansmink in #14069
* bump substrait by @pdet in #14055
* CIBW_SKIP also musllinux on Python 3.7 or Python 3.8 by @carlopi in #14074
|
| 2024-09-25 09:32:13 by =?UTF-8?B?RnLDqWTDqXJpYyBGYXViZXJ0ZWF1?= | Files touched by this commit (1) |
Log message:
duckdb: Fix build on macOS
pkgsrc changes:
---------------
* Remove lib/libjemalloc_extension.a from PLIST since it is in PLIST.x86_64
(see https://mail-index.netbsd.org/pkgsrc-changes/2024/06/16/msg301974.html)
|
| 2024-09-17 08:10:43 by Ryo ONODERA | Files touched by this commit (3) | |
Log message:
databases/duckdb: Update to 1.1.0
Changelog:
1.1.0
What's Changed
* Add feature changes back in by @Mytherin in #11146
* Make MultiFileReader filename configurable by @lnkuiper in #11178
* [Dev] Fix compilation issues on feature by @Tishj in #11082
* add query() and query_table() functions by @chrisiou in #10586
* [Block Size] Move the block allocation size into the block manager by
@taniabogatsch in #11176
* LIMIT pushdown below PROJECT by @jeewonhh in #11112
* BUGFIX: IN () filter with one argument should translate to = filter. by
@Tmonster in #11473
* Regression Script should calculate micro benchmark differences with the
correct base branch by @Tmonster in #11762
* Pushdown filters on window partitions by @Tmonster in #10932
* Arrow ListView Type by @Tishj in #10766
* Add scalar function support to the C API by @Mytherin in #11786
* Add TopN optimization in physical plan mapping by @kryonix in #11290
* Join-dependent filter derivation by @lnkuiper in #11272
* Implement ROW_GROUPS_PER_FILE for Parquet by @lnkuiper in #11249
* Prefer Final projected columns on probe side if cardinalities are similar
by @Tmonster in #11109
* Propagate unused columns to distinct on by @Tmonster in #11006
* Separate eviction queues by FileBufferType by @lnkuiper in #11417
* Disable false positive for vector size nightly in test by @taniabogatsch in
#11953
* Rework jemalloc extension by @lnkuiper in #11891
* Tweak jemalloc config by @lnkuiper in #12034
* Httpfs test to nightly by @carlopi in #12196
* Removed three reinterpret casts and some rewriting by @taniabogatsch in #
12200
* Begin Profiling Rework to move towards Modularity by @maiadegraaf in #11101
* [CLI] Add highlighting + limited auto-complete for shell dot commands by
@Mytherin in #12201
* Skip test to fix block size nightly and add more explicit error checking by
@taniabogatsch in #12211
* Remove BLOCK_ALLOC_SIZE from the column segment files by @taniabogatsch in
#11474
* [Julia] - Added optional schema input argument to DuckDB.Appender
constructor by @curtd in #12174
* Fix Mark Index in the Bound Join Ref by @pdet in #12263
* Fix for CI Regression Failure by @maiadegraaf in #12273
* ? by @samansmink in #12303
* Disable JEMALLOC_RETAIN by @lnkuiper in #12185
* Enforce compression extensions for CSV Files by @pdet in #11903
* Make spuriously failing test more robust by @lnkuiper in #12306
* Add new extensions to issue template by @szarnyasg in #12313
* [Fix] Block size nightly run by @taniabogatsch in #12283
* Spell Check | Nothing Major | Corrected base_scanner.cpp by @nj7 in #12282
* add duckdb_bind_timestamp_tz function to C API by @karlseguin in #12151
* [Python] Add some date/datetime functions to pyspark api by @mariotaddeucci
in #12075
* Fixes to Windows workflow and ubuntu_18 action by @carlopi in #12308
* [Extension Dev] Forward declare re2 in hive_partitioning.hpp by @Tishj in #
12302
* add expected errors to test/sql/copy/per_thread_output.test by @hmeriann in
#12280
* Issue #12287: ICU Strptime Lists by @hawkfish in #12295
* Issue #12171: Streaming Window FILTER by @hawkfish in #12250
* [Python] Update the Connection wrapper generation, now generates c++ code
by @Tishj in #12216
* Use iterator buffer position when storing buffer handles by @pdet in #12315
* Bump Julia client to v0.10.3 by @Mytherin in #12323
* Fix #12286 - in the MetadataManager, prefer to allocate new blocks if the
next free block id is smaller than the currently used metadata block by
@Mytherin in #12318
* [Fix] Only read file size if file handle still exists by @taniabogatsch in
#12319
* Add support for APPEND argument to hive partitioned write by @Mytherin in #
12262
* Remove all reinterpret casts from the transformer by @taniabogatsch in #
12320
* Additional check for overlapping CTE names by @lnkuiper in #12305
* [Dev] STANDARD_VECTOR_SIZE and BLOCK_ALLOC_SIZE can now be set through the
Makefile by @Tishj in #12164
* [Upsert] Fix issue with lambdas in DO UPDATE SET expressions by @Tishj in #
11866
* [Python] Fix scoping issue for pandas_analyze_sample setting by @Tishj in #
11706
* Support REGEX matches expected error message by @hmeriann in #12327
* Allow run_fuzzer to reduce multi statements. by @Tmonster in #12278
* Fix #12328 - when flattening STRUCT vectors with NULL values, we need to
flatten the children recursively as well by @Mytherin in #12332
* Make dbgen generate data in parallel by @Mytherin in #12337
* dbgen: skip parallel generation if DUCKDB_NO_THREADS is set by @Mytherin in
#12341
* Add prefix prefix_front_back. to get prefix_front_ and prefix_back_ by
@liujiayi771 in #12344
* Issue #12171: Streaming Windowed DISTINCT by @hawkfish in #12311
* Update README by @szarnyasg in #12357
* [CSV Reader] [Skip Option] Tests and fixes by @pdet in #12213
* Adjust BM25 score in FTS extension to prevent negative scores by @lnkuiper
in #12356
* Fix typos by @szarnyasg in #12360
* Fix #12293 - accept NULL values in generate_series with timestamp by
@Mytherin in #12367
* Fix #12335: avoid calling fsync when writing Parquet files, instead just
close the file by @Mytherin in #12371
* Fix parameters passed down to other workflows in OnTag.yml by @carlopi in #
12369
* [Python] Fixes for the SQLLogicTest runner implementation by @Tishj in #
12372
* Bump julia to v1.0.0 by @Mytherin in #12379
* Fix #11921 - varchar -> timestamp casts are not invertible by @Mytherin in
#12376
* Upgrade utf8proc - and move our custom extensions out of utf8proc itself by
@Mytherin in #12373
* change max_queries number back to 2000 by @Tmonster in #12375
* Remove sqlsmith extension by @Tmonster in #12300
* Reorder semi and anti joins. by @Tmonster in #11815
* Issue #12351: implicit cast to TIMESTAMP_MS, TIMESTAMP_S, TIMESTAMP_NS from
DATE values by @akoshchiy in #12352
* Issue #10023: Approx_Count_Distinct Memory Usage by @hawkfish in #12355
* Fix a small typo in dev instructions for swift setup by @gjmwoods in #12383
* Release lock before returning BufferHandle in StandardBufferManager::Pin by
@lnkuiper in #12391
* Remote attach autoload by @carlopi in #12393
* Add JSON type to Parquet reader/writer by @lnkuiper in #12222
* Add RETURN_FILES parameter to COPY TO by @lnkuiper in #12220
* Updated JoinHashTable to use linear probing to resolve hash collisions by
@gropaul in #11472
* [Benchmark Runner] Add --disable-timeout flag by @Tishj in #12387
* Don't replace unicode spaces within $$ quotes in query strings by @lnkuiper
in #12405
* [Python] Fix fatal exception caused by empty Pandas Categorical objects. by
@Tishj in #12370
* Release CSV Blocks when acquiring new blocks if single threaded by @pdet in
#12409
* Add support for prefetching multiple adjacent blocks in a single batched
read when attaching to remote databases by @Mytherin in #12413
* MatchRegex() fixed to do not return false positive result by @hmeriann in #
12396
* Expected errors 2053 by @hmeriann in #12392
* [C-API] Catch exception in duckdb_execute_prepared by @Tishj in #12414
* Combining LIST_CONCAT and CONCAT binding by @maiadegraaf in #12317
* [Appender] Add AppendDefault by @Tishj in #11905
* [Python Dev] Push CTE internally for every (python) replacement scan that
occurred. by @Tishj in #12161
* Improve compiler compatibility by @krlmlr in #12401
* Write zero-length list offsets for NULL values when serializing vectors by
@Mytherin in #12423
* Get column statistics if Logical Get has a statistics function by @jeewonhh
in #12424
* jemalloc: Identify GNU source code properly by @lnkuiper in #12420
* Avoid parallelizing LIMIT clauses when the query plan is simple by
@Mytherin in #12433
* Prefetch metadata blocks for remote files by @Mytherin in #12437
* [Jupyter] Remove width limit on the BoxRenderer config by @Tishj in #12443
* Revert #10865 by @carlopi in #12426
* inline delta by @samansmink in #12435
* Account for tagged dollar-quoted strings when stripping unicode spaces by
@lnkuiper in #12421
* Work-around for broken github windows runner by @Mytherin in #12447
* Prevents clearing of the types of the LogicalExecute operator by
@NiclasHaderer in #12436
* Add support for BEGIN TRANSACTION READ ONLY by @Mytherin in #12202
* Make range and generate_series table in-out functions, and fix several
issues with table in-out functions by @Mytherin in #12431
* Issue #12412: AsOf Filter Push by @hawkfish in #12448
* [Fix] Block Size Nightly by @taniabogatsch in #12427
* [ART] Remove Flatten and template key generation by @taniabogatsch in #
12428
* [Python] Clean up internals of execute / executemany by @Tishj in #12434
* By default attach remote databases as READ_ONLY by @carlopi in #12461
* Fix #11837: use internal physical type for FIRST/LAST/ANY_VALUE instead of
logical type by @Mytherin in #12462
* Issue #12464: Windowed Order By All by @hawkfish in #12470
* Specialize list_value for primitive types for significantly improved
performance by @Mytherin in #12468
* [Dev] Remove dead code from PhysicalBatchCopyToFile by @Tishj in #12459
* Disable Windows extensions CI until Github actions runners are fixed by
@Mytherin in #12479
* [Fix] access_mode now lives in AttachOptions by @taniabogatsch in #12482
* Internal #2186: Nanosecond Functionality by @hawkfish in #12440
* [C-API] Fix leak in duckdb_create_config by @Tishj in #12465
* [Python] No longer scan the entire frame lineage in a replacement scan,
added option to disable (python) replacements entirely by @Tishj in #12425
* throw binder error for comment on system catalog by @samansmink in #12486
* Parquet reader performance by @lnkuiper in #12478
* Operators the Optimizer can skip by @Tmonster in #12489
* Fixes clang conversion warnings by @TinyTinni in #12467
* Avoid creating internal schemas as non-internal when reading old database
files by @Mytherin in #12456
* Allow parquet encryption/decryption keys to be passed in as base64 encoded
strings by @elefeint in #12445
* [Block Size] Introducing CompressionInfo by @taniabogatsch in #12481
* add the number of filtered files to explain by @samansmink in #12488
* Implement Map Type Detection for JSON Reader by @ZiyaZa in #11285
* [Dev] Remove busy-spin from ClientContext::ExecuteTaskInternal by @Tishj in
#12483
* Pluggable collations by @Mytherin in #12492
* [Dev] Don't fail make generate-files if the python code generation fails by
@Tishj in #12500
* Optimize EXTRACT(year/month/day FROM date/timestamp) by @Mytherin in #12499
* [Fix] Remove BLOCK_ALLOC_SIZE in the single file block manager by
@taniabogatsch in #12502
* Revert Windows CI fixes by @carlopi in #12510
* Fix #12467 changes to covariance calculation by @carlopi in #12515
* [Python] Fix reading strided datetime and timedelta columns by @Tishj in #
12519
* Add method for decoding sort keys, and use this in min/max for arbitrary
types by @Mytherin in #12520
* Reduce allocations & use predication in ColumnSegment::FilterSelection by
@Mytherin in #12521
* Skip only built-in optimizers by @Mytherin in #12522
* Improve min/max performance for strings and fallback types by @Mytherin in
#12524
* Move arg_min/arg_max to use sort keys by @Mytherin in #12525
* Move FIRST/LAST/ANY_VALUE to use sort keys by @Mytherin in #12526
* CMake: use GNUInstallDirs as defaults for INSTALL_{BIN,LIB,INCLUDE}_DIR by
@paparodeo in #12509
* More formatting and fix to stddev by @carlopi in #12516
* Linux Extensions CI: Attempt at fix missing dependencies by @carlopi in #
12429
* Fix checkouts by @carlopi in #12366
* Etag if none match for extension install by @carlopi in #12333
* [Block Size] FixedSizeAllocator, MetadataManager, PartialBlockManager by
@taniabogatsch in #12514
* [Python] Skip the PandasAnalyzer if dtype is 'string' by @Tishj in #12511
* [StreamQueryResult] Batched variant of the StreamQueryResult collector by
@Tishj in #11494
* Move many tests to slow by @Mytherin in #12534
* Add support for arg_min(ANY, ANY) by @Mytherin in #12532
* Avoid overriding types in PrepareTypeForCast when not required by @Mytherin
in #12539
* Support all types in histogram function by @Mytherin in #12538
* [Python] Remove busy-spin during execution by @Tishj in #12512
* [Block Size] String space constant by @taniabogatsch in #12537
* Use string_t instead of std::string in histogram by @Mytherin in #12545
* Add support for binned histograms by @Mytherin in #12548
* [Upsert] Fix RETURNING for DO NOTHING by @Tishj in #12554
* Build Android Binaries by @hannes in #12550
* [CI] Remove pyarrow version lock by @Tishj in #12566
* [Dev] Change tests: np.NaN -> np.nan by @Tishj in #12565
* Internal #2017: DECIMAL Downcast Rounding by @hawkfish in #12036
* Issue #12204: Summarize Temporal Quantiles by @hawkfish in #12297
* Internal #2186: Nanosecond StrTimeFormat by @hawkfish in #12551
* Add support for equi_width_bins function to compute histogram boundaries by
@Mytherin in #12574
* add support for casting 'yes'/'no' strings to boolean values by @chrisiou
in #12501
* Julia: Add chunked results with Tables.partitions() by @frankier in #12395
* [PySpark] - Allow spark session range by @mariotaddeucci in #12346
* [PySpark] Implement subset drop duplicates by @mariotaddeucci in #12348
* ICU noaccent collation by @tiagokepe in #12170
* Implement Brotli compression for Parquet reading & writing by @hannes in #
12103
* [FriendlySQL] Unpacked COLUMNS() Expression by @Tishj in #11872
* [PySpark] Implement UDFRegistration.register method on PySpark api by
@mariotaddeucci in #12179
* [Python] Don't use np.nan, deprecated alias starting with NumPy 2.0 by
@Tishj in #12583
* Add bind_expression callback to scalar function, and use it to turn typeof
into a BoundConstantExpression by @Mytherin in #12580
* Add can_cast_implicitly scalar function by @Mytherin in #12581
* Add support for histogram and histogram_values table macro, and add support
for default table macros (similar to how we support default macros) by
@Mytherin in #12590
* build: swap libclang for cxxheaderparser by @Mause in #12567
* [C-API] Add table_description struct to query various information about the
table. by @Tishj in #12460
* Change new micro benchmark script to only look for .benchmark files by
@maiadegraaf in #12598
* Add HTTP error code to extension install failures by @carlopi in #12608
* Separate WAL write from commit, and allow writing to the WAL without
holding the transaction lock by @Mytherin in #12261
* Add OwningStringMap - and rework histogram and mode functions to use this
by @Mytherin in #12601
* Feature #1272: Window Executor State by @hawkfish in #12573
* Add support for any type to mode aggregate by @Mytherin in #12619
* WAL - when dropping a table, also delete any transaction local storage
associated with that table by @Mytherin in #12603
* [Python] Allow Generators to be passed where List is expected by @Tishj in
#12602
* VectorOperations::Copy - fast path when copying an aligned flat validity
mask into a flat vector by @Mytherin in #12618
* Move android CI to only run during nightly CI triggers by @Mytherin in #
12622
* Add initial support for GeoParquet + Bump spatial by @Maxxen in #12503
* Issue #12600: Streaming Positive LAG by @hawkfish in #12609
* Feature #1272: Window Group Preparation by @hawkfish in #12628
* Minor window improvements by @Mytherin in #12617
* Merge feature into main by @Mytherin in #12633
* Refactor quantile aggregate - clean up code & support quantile_disc/median
for all types by @Mytherin in #12630
* Feature 1272: Window Payload Preallocation by @hawkfish in #12629
* [ART] Configurable index scan threshold by @taniabogatsch in #12635
* Subtract start offset for when fetching array child segment by @Maxxen in #
12639
* Remove custom logic to detect main vs feature by @carlopi in #12643
* Do not quote fields with space in the CSV output mode by @szarnyasg in #
12644
* Use lowercase in 'html' output mode by @szarnyasg in #12612
* Internal #2361: Window ROWS Overflow by @hawkfish in #12652
* Quantile: Fix variable used only in D_ASSERT by @carlopi in #12642
* Skip pytorch test, it fails spuriously in CI by @carlopi in #12645
* Add histogram_exact function that adds values to bins only if they match
exactly, and add other column that contains values that do not fit in any
bin by @Mytherin in #12650
* Add operator hook for sink progress by @Maxxen in #12637
* Regression workflow on newly introduced benchmarks: remove for now by
@carlopi in #12659
* Fix #12646 - allow SQL value functions in HAVING by @Mytherin in #12654
* Add != operators on string_t and interval_t by @carlopi in #12658
* fix: improve C scalar functions API by @rustyconover in #12663
* Add approx_top_k aggregate based on the (Filtered) Space-Saving algorithm,
and use it in histogram by @Mytherin in #12653
* Fix std::sort requirements, from greater_equal to greater by @carlopi in #
12669
* fix(parquet): two-complement zeroes check on FIXED_BYTE_ARRAY encoded
DECIMAL (#12621) by @fedefrancescon in #12655
* [CSV Reader] Reorder of Columns for CSV Scans on multiple files. by @pdet
in #12288
* [CSV] [Bug-Fix] Fix for issue related with single-threaded execution and
null padding. by @pdet in #12679
* [Block Size] String block limit and a few other places by @taniabogatsch in
#12671
* Rework arena allocator allocation policy - and increase pivot threshold by
@Mytherin in #12690
* Julia - Fix Base.isopen(db::DB) in #12700
* [CLI] Limit history size to 100MB, and avoid writing invalid UTF8 to the
CLI history by @Mytherin in #12677
* Add configurable thresholds for using nested loop join and merge join by
@Mytherin in #12689
* Prevent unnecessary usage of std::string in list aggregate - and use more
efficient memcpy for batched copy by @Mytherin in #12694
* Dont load spatial unless geoparquet metata is present by @Maxxen in #12692
* Serialization: add CustomData and better support for integrating with
extensions by @jeewonhh in #12681
* Removing ODBC driver by @hannes in #12706
* Support thousand separator for floating point numbers by @Mytherin in #
12717
* [Python] Use non-owning references to hold created cursors by @Tishj in #
12711
* LIST(VARCHAR) - reduce memory usage by avoiding allocation of nullmask for
string data, and allocate larger initial batches by @Mytherin in #12705
* [CSV] Bug fix for race condition in single-threaded multifile reader +
properly print paths on union_by_name errors. by @pdet in #12697
* Issue template: Add ODBC and Node (neo) clients by @szarnyasg in #12714
* Shell: add .sql suffix to temporary file created with \e by @Mytherin in #
12723
* Partitioned write - keep only up until 100 files open, when this limit is
exceeded close the file and create a new file if more data for this
partition appears by @Mytherin in #12708
* Change setting types to fix warnings by @Mytherin in #12724
* Avoid unnecessarily copying child expression when binding COLLATE
statements by @Mytherin in #12725
* Support for variadic arguments in scalar UDFs in the C API by
@taniabogatsch in #12678
* [Relation API] Dont push DISTINCT modifier for EXCEPT/INTERSECT ALL by
@Tishj in #12599
* Builds for Windows on ARM64 by @hannes in #12586
* Rework union_by_name so that files are no longer kept open by @Mytherin in
#12730
* Fix #12729: early-out when checking for perfect hash joins when running on
empty tables by @Mytherin in #12731
* CLI: Replace \n with \r\n again in history again by @Mytherin in #12735
* Fix #11228 - add support for unsigned integers in printf/format by
@Mytherin in #12736
* Various CI fixes by @Mytherin in #12737
* Add repeat(LIST[], INT) that allows repetition of lists similar to how this
is allowed in Python by @Mytherin in #12738
* [Python] Add missing options to read_json method by @Tishj in #12732
* Add support for fetching cardinality estimation and stats through a
multifilelist by @samansmink in #12740
* Fixes warnings detected by cppcheck by @carlopi in #12745
* [Arrow] Add ArrowQueryResult by @Tishj in #12496
* [Dev] StreamQueryResult internals cleanup by @Tishj in #12636
* ALP/ALPRD: correctly skip when we are skipping fewer values than in a
vector by @Mytherin in #12753
* Maintain prepared statement parameter types explicitly instead of
converting into literals by @Mytherin in #12759
* CLI .changes: use sqlite3_changes64 and sqlite3_totalchanges64 to prevent
overflows by @Mytherin in #12761
* Fix #12569: avoid truncating zeros that matter in format function by
@Mytherin in #12762
* Fix #12418: Remove .lint command in SQLite shell by @Mytherin in #12763
* Fewer system calls in LocalFileSystem::ListFiles by @Mytherin in #12769
* Support indexes in COPY DATABASE by @Mytherin in #12768
* Issue #12600: Batched LEAD/LAG by @hawkfish in #12770
* Issue #12600: Streaming Positive LEAD by @hawkfish in #12685
* Add dl functionality for Windows by @ccfelius in #12765
* Fix stale bot permissions, with @szarnyasg by @carlopi in #12782
* [CI] Stale bot: actually add permissions by @carlopi in #12786
* Fix FILE_SIZE_BYTES test (again) by @lnkuiper in #12779
* Fix extended tests in CI by @carlopi in #12781
* Patch CentOS 7 EOL causing CI failure by @samansmink in #12788
* Allow extensions to optionally add own description (on load) by @carlopi in
#12754
* Internal #2429: Shifted LEAD NULLs by @hawkfish in #12791
* Issue #12784: Months Before Days by @hawkfish in #12794
* bump vss by @Maxxen in #12797
* Remove centos workaround by @samansmink in #12801
* For compressed deletes in the undo buffer - count the actual size that will
be written to the WAL when determining the auto-checkpoint threshold by
@Mytherin in #12803
* feat: new inet functions by @panga in #12575
* [Dev] MakeExecutor::ResultCollectorIsBlocked less trigger-happy by @Tishj
in #12780
* Fix #12798: Add head file to fix debug build incomplete type error by
@zzachimed in #12810
* [Block Size] Switching to configurable block sizes by @taniabogatsch in #
12691
* [Dev] Clean up the generate_serialization.py script a bit by @Tishj in #
12823
* Remove micro extended from duckdb/duckdb by @hmeriann in #12792
* [Python] Allow pathlib.Path to be provided to duckdb.connect by @Tishj in #
12809
* remove .py scripts migrating to the sqlsmith by @hmeriann in #12827
* Some expected error messages added by @hmeriann in #12825
* [Fix] list_resize by @taniabogatsch in #12832
* [Python] Python SQLLogicTester maintenance by @Tishj in #12833
* [Python] Accept a list of Expression objects in DuckDBPyRelation.aggregate
by @Tishj in #12812
* [Copy Database] Don't include generated columns in the copied data by
@Tishj in #12835
* [Julia] Added Appender support for Int128, UInt128, and Base.UUID values by
@curtd in #12836
* [Python] Fix extraction of days/seconds/microseconds from timedelta object
by @Tishj in #12760
* [Python] Output a regular key -> value dict for hashable keys by @Tishj in
#12734
* [Dev] Change internals of StringUtil::GenerateRandomName by @Tishj in #
12806
* [CSV] Adaptive Sniffer by @pdet in #12698
* Fix LinuxRelease.yml after bump to Node 20 by @carlopi in #12850
* Fix: Reduce repeated judgment in ties[i]. by @Light-City in #12840
* add html_escape and html_unescape functions in inet extension by @chrisiou
in #11191
* Fix union struct implict cast by @Maxxen in #12847
* Update httplib from v0.10.2 to v0.14.3 by @lnkuiper in #12849
* Fix an issue where parameters would be promoted to NULL, incorrectly
causing PREPARE to fail by @Mytherin in #12844
* More expected error messages added by @hmeriann in #12846
* Overload MIN/MAX/MAX_BY/MIN_BY to return the "top" N values by \
@Maxxen in #
12834
* Fix #12789: list_zip support array by @flashmouse in #12859
* [Python] Fix missing ConnectionException errors by @Tishj in #12864
* Make equi_width_binning buckets even nicer by @Mytherin in #12878
* Add a JSON pretty print function by @PhictionalOne in #12398
* Add Metrics Support in the CAPI by @maiadegraaf in #12498
* Update issue template by @szarnyasg in #12880
* Fix regression in Parquet reader TryOpenNextFile by @lnkuiper in #12848
* Improve performance of memory usage counters by @yiyuanliu in #12751
* [Fix] No String Inline / Destroy Unpinned Blocks nightly run by
@taniabogatsch in #12884
* Fix LinuxRelease.yml CI by avoiding upload by @carlopi in #12891
* Do not depend on manylinux extension in Python's CI by @carlopi in #12895
* [Dev] Fix failing test in test_relation_api.cpp by @Tishj in #12894
* [Dev] Skip test_run_pandas_with_tz on pandas <2.0.0 by @Tishj in #12896
* Fix #12688: Julia SubString handling by @dhanak in #12899
* [Python-Dev] Add DependencyException, throw earlier if PendingQuery fails
by @Tishj in #12888
* [Fix] Mixing block sizes and compression functions by @taniabogatsch in #
12858
* Fix issue with list radix serialization by @lnkuiper in #12887
* Respect limit during join order by @Tmonster in #12851
* [CHORE]: Fix minor SQL test case by @Tmonster in #12909
* Fixes for duckdb_constraints and information_schema constraint tables by
@Mytherin in #12914
* [Postgres Compatiblity] Support => to supply named parameters to functions
by @Tishj in #12913
* Pushdown table filters into probe based on min/max data found during hash
build of hash joins by @Mytherin in #12908
* Count nulls when detecting JSON structure by @lnkuiper in #12883
* Fix #12870 - improve error message when encountering schema mismatches in
COPY tbl FROM file.parquet by @Mytherin in #12918
* Use different versions of snappy depending on the compiler by @lnkuiper in
#12889
* Fix Issues with type detection for Doubles/Floats/Decimals by @pdet in #
12866
* Pass 'Unsecure_node_version' to allow node16 for a bit longer by @carlopi
in #12922
* Minor refactor for window_executor by @ZhangHuiGui in #12924
* ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION:false for Android and Nightly by
@carlopi in #12930
* [Fix] Vector verification for dictionary expressions by @taniabogatsch in #
12890
* Return smaller cardinality for Top N operator by @jeewonhh in #12932
* Make GCC Happy Again by @carlopi in #12937
* [Fix] More robust parquet metadata test by @taniabogatsch in #12935
* Rework table filters, and for each row group only execute table filters if
they can actually filter out any rows by @Mytherin in #12938
* Issue #12941: Window Constant Results by @hawkfish in #12943
* Expected errors 2053 by @hmeriann in #12927
* Make ErrorData::Message() and ErrorData::RawMessage() const by @Flogex in #
12885
* Feature #1272: Window Parallel Sink by @hawkfish in #12907
* [Arrow] Add PhysicalArrowBatchCollector, a batched result collector for the
ArrowQueryResult by @Tishj in #12787
* [Python] Rework internals of object registration by @Tishj in #12625
* [StreamQueryResult] Add ExecuteTask method to StreamQueryResult by @Tishj
in #12824
* Fix several CTE related issues by @kryonix in #12948
* Label mark joins with convert to semi by @Tmonster in #12916
* [Julia]: Added FixedDecimal support to Appender API by @curtd in #12923
* Pushdown dynamically generated filters into MultiFileList, allowing
partitions to be pruned by @Mytherin in #12955
* Automatically materialize CTEs by @lnkuiper in #12290
* Move checkpointing parallelism into TaskExecutor class, use that class for
parallel union_by_name by @Mytherin in #12957
* [Dev] Uncouple HTTPState from core by @Tishj in #12912
* [Dev] Clean up TreeRenderer code by @Tishj in #12716
* Swap build side and probe side base on cardinality AND width of build side.
by @Tmonster in #12755
* [Python] Use Set instead of List for the get_table_names stubs by @Tishj in
#12963
* Feature #1272: Window Validity Array by @hawkfish in #12954
* [CSV Reader] Make glob reading more permissive to errors if ignore_errors
is set by @pdet in #12966
* [Python] Convert ENUM to np.array instead of pd.Categorical for fetchnumpy
by @Tishj in #12964
* Several hive partitioning fixes by @Mytherin in #12970
* fix incorrect int32 appender by @piever in #12956
* Add missing TransformCTE extraction to TransformRecursiveCTE by @kryonix in
#12968
* Expected errors 2053 by @hmeriann in #12969
* Add Pyodide 0.26.1 (corresponding to Python 3.12) by @carlopi in #12965
* Avoid adding a suffix to Parquet files when doing a partitioned write by
@Mytherin in #12972
* URL Encode/Decode Hive Partitioning Columns/Filters + add url_encode/
url_decode scalar functions by @Mytherin in #12974
* Fix JSON extension Cmake by @carlopi in #12975
* Clarify when it's necessary to refresh data and validity pointers by
@Giorgi in #12973
* Added new information_schema views - closes #4343 by @prmoore77 in #12942
* Use jaro winkler similarity for finding similar entries in catalog by
@Mytherin in #12980
* Internal #2503: Streaming Window Reset by @hawkfish in #12984
* Fix #12933: maintain insertion order in window when the window clause is
empty (i.e. over ()) by @Mytherin in #12982
* Feature #1272: Window Constant Sink by @hawkfish in #12979
* Remove special case for '+' in URLs in httplib by @lnkuiper in #12929
* Rebind prepared statements based on catalog versions by @ywelsch in #12829
* Allow string stats larger than our default for parquet row group pruning by
@lnkuiper in #12928
* Add work-around for R client table function initialization back in under a
config setting by @Mytherin in #12990
* [Dev] Add getters/setters for the 'column_ids' of a LogicalGet by @Tishj in
#12971
* Accelerate Parquet en/decryption with HTTPFS extension by @ccfelius in #
11720
* remove deprecated CDN invalidations by @samansmink in #12997
* add large ingestions by @hmeriann in #12949
* Fix shared_ptr issues in RowGroup and add locks to WAL initialization by
@Mytherin in #13000
* Add the ANY type and special null handling to the C API by @taniabogatsch
in #12785
* Improve error messages in the presence of subqueries by @Mytherin in #13001
* Case-insensitive NULL casting in VARCHAR -> STRUCT casts by @lnkuiper in #
13003
* TemporaryMemoryManager improvements by @lnkuiper in #12931
* Make sure that empty and only white space headers have same treatment by
@pdet in #12994
* Push timestamp_tz to do direct casting if ICU is not loaded by @pdet in #
12993
* [Dev] Add query to QueryRelation for logging by @Tishj in #13004
* [Spark API] Fix group by compatibility issues by @Tishj in #13005
* [CSV] Progress Bar for compressed files. by @pdet in #12728
* Disable fixed size map in PartitionedTupleData by @Mytherin in #13013
* Fix parallel creation and destruction of instances through the
DBInstanceCache by @Mytherin in #13010
* Avoid generating join filters for interval columns by @Mytherin in #13014
* Extend least/greatest to support all types, and always return the same type
as its input types by @Mytherin in #13019
* Add sha1(varchar) -> varchar scalar function by @bradlarsen in #13020
* Decimal to FloatingPoint: Avoid losing precision by splitting operation in
two, more fixes and tests by @carlopi in #12627
* Feature #1272: Segment Tree Finalize by @hawkfish in #13002
* Create Delimiter Join and Delimiter Get via Relations by @pdet in #12953
* Fix CTE/noalternativeverify issues by @lnkuiper in #13024
* Fix bug in reworked fixed_size_map_t by @lnkuiper in #13023
* Fix abs for floating point negative zero by @Mytherin in #13025
* [Nightly-Bug] [CSV Reader] Use strings on header detection by @pdet in #
13028
* Release GIL during DB instantiation by @ywelsch in #13029
* GCC 4.8: add noexpr to 2 constructors by @carlopi in #13030
* Fixes for LogicalType::ANY and fixed_size_map by @Mytherin in #13035
* [Nightly] Fix for arrow appending fixed size lists by @pdet in #13039
* fix storing persistent secrets in home dir by @samansmink in #13033
* Internal #2534: IGNORE NULLS Threading by @hawkfish in #13050
* [Julia] Only commit transaction on non-error (compat) by
@genericallyterrible in #13049
* Improve EXPLAIN output of Delim Joins and Delim Gets by @kryonix in #12995
* Make client reuse threadsafe by @samansmink in #13052
* Only remove the first occurrence of extension prefix by @jeewonhh in #13057
* Fix incorrect overflow in left shift of unsigned number by @Mytherin in #
13056
* Add tests for sha1 function by @bradlarsen in #13064
* [Relation] ViewRelation could be created without an alias by @Tishj in #
13054
* Support IN operator for LIST by @Tishj in #12920
* [Python] Read from file-like objects with read_json by @Tishj in #13040
* [Python] Fix lifetime issue with MaterializedRelation by @Tishj in #12998
* PySpark sort by columns and DataFrame.getitem by @khalidmammadov in #12981
* Fix trouble to compile with MSVC by @annnei in #12579
* Create a dedicated RegisteredStateManager that manages client context
states in a thread-safe manner by @Mytherin in #13027
* DEBUG_STACKTRACE should not be enabled for release builds by @Mytherin in #
13070
* Add blob overloads to crypto functions, and turn md5_number_lower and
md5_number_upper into macros by @Mytherin in #13068
* Internal #2534: IGNORE NULLS Threading by @hawkfish in #13065
* Variable Integer Size Type by @pdet in #13015
* Simplify binding of CALL statement by @Mytherin in #13074
* Fix #13045: flatten in list_inner_product by @Mytherin in #13076
* Fix for unpivot on zero columns by @Mytherin in #13073
* Add support for overloading to macros by @Mytherin in #13062
* Internal #2534: Windowed FILTER Threading by @hawkfish in #13086
* Fixup #12579, remove pessimizing std::move by @carlopi in #13089
* [CSV Reader] Fix when reading overbuffer values of csv files with extra
delimiter by @pdet in #13081
* Making error messages more clear for new line delimiter errors by @pdet in
#13082
* [CSV Sniffer] Sniffer can now sniff files with extra delimiters by @pdet in
#13083
* Remove test in Pyodide due to weird pandas interactions by @carlopi in #
13091
* Add support for SQL-level variables by @Mytherin in #13084
* Fix wasm CI and add missing template argument by @carlopi in #13094
* Some clang tidy fixes around narrowing casts by @carlopi in #13105
* chore: PushdownAggregate fast path by @lichuang in #13098
*
+ fix list_distance & list_cosine_similarity execute fail when list i??
by @flashmouse in #13090
* [Explain] Add EXPLAIN (FORMAT JSON) syntax by @Tishj in #12967
* Expected errors 2053 by @hmeriann in #13107
* [Bug] Enum types not being found if created in a schema by @pdet in #13106
* Parquet reader can now read files with duplicate column names by @hannes in
#13111
* Prefer aliases over column-value functions in GROUP BY, and prefer error
message when alias is used in an expression by @Mytherin in #13118
* Disallowing DISTINCT, FILTER and ORDER BY for UNNEST by @hannes in #13110
* Feature #1272: Windowed DISTINCT Sink by @hawkfish in #13093
* adjust list value logic execute seq by @flashmouse in #13114
* add CORE_EXTENSIONS build flag by @samansmink in #13116
* [Python] Add missing options for read_csv by @Tishj in #12872
* Fix merge conflict by @Mytherin in #13126
* Retry on HTTP failure in extension install by @Mytherin in #13122
* Clean up ChunkInfo when cleaning up a transaction by @Mytherin in #13125
* typo: conjuction -> conjunction by @qsliu2017 in #13127
* Add duckdb_result_error_type that returns the exception type of the error
by @Mytherin in #13131
* Keep track of user-provided configuration options, and compare them as well
for database instance caching purposes by @Mytherin in #13129
* Disable sniff_csv when enable_external_access is not set by @hannes in #
13133
* Internal #2577: Window Atomic Finalize by @hawkfish in #13117
* Internal #2577: Window Tree Allocation by @hawkfish in #13119
* Fix optimizer error when dealing with IN with a single NULL parameter by
@Mytherin in #13139
* Internal #2597: Ragged Validity Array by @hawkfish in #13137
* Create file with O_EXCL flag set. by @mkaruza in #13123
* better CE for comparisons that use =, !=, <, <=, >, >=. by \
@Tmonster in #
13130
* Use Slurm env vars to manage cpu and memory allocation if run inside Slurm
HPC job by @dirkpetersen in #12978
* Fix CTEFilterPusher optimization by @kryonix in #13142
* Test with recent threadsanitizer by @carlopi in #13124
* Fixes for RegexFindAll function errors and multibyte character support by
@chrisiou in #13108
* clang-tidy: rework Makefile and CI by @carlopi in #13101
* Extension updates to also be logged via enable_http_logging by @carlopi in
#13087
* Hooks now get an error to indicate transaction/query success. by
@NiclasHaderer in #13136
* Use alias bind path in ORDER BY when running COLLATE by @Mytherin in #13140
* Implementation of recursive JSONPath expressions by @robert-s01 in #12991
* Adding option to disable materialized cte optimization by @pdet in #13146
* [Python] Fix issue with native UDFs returning STRUCT items by @Tishj in #
13147
* CGroups: fix compilation due to UB cast by @carlopi in #13151
* test_expression.py: Skip throw related test on Windows by @carlopi in #
13157
* Replaced while loop with if statement by @NiclasHaderer in #13161
* ThreadSanitizer: Avoid spurious data race in
InsertMatchesAndIncrementMisses by @carlopi in #13179
* Add 'bugprone-narrowing-conversions' clang-tidy check by @carlopi in #13180
* [C API] Return duckdb_value in duckdb_profiling_info_get_value by
@taniabogatsch in #13160
* Fix #13120: implement StructFilter::ToExpression by @Mytherin in #13182
* Feature #1272: Windowed DISTINCT Sort by @hawkfish in #13150
* Add native list_has_any implementation by @Maxxen in #13163
* Add pragma extension versions by @samansmink in #13063
* [C API] Add duckdb_scalar_function_set_volatile that allows changing
FunctionStability of a scalar function by @Mytherin in #13186
* [CSV Sniffer] Give preference to configurations that ignore the least
amount of lines by @pdet in #13188
* Fix #13017 - if grabbing the lock fails due to it not being supported,
allow this in read-only mode by @Mytherin in #13189
* Add test_collate_pivot: used to fail in 1.0.0, add to avoid regressions by
@carlopi in #13190
* Add catalog_error_max_schemas setting that toggles how many schemas we look
at for "did you mean..." style error messages by @Mytherin in #13191
* Fix build error when compiling with -DDISABLE_EXTENSION_LOAD=1 by
@whatsthecraic in #13194
* Add clang-tidy-diff script, and invoke it on PRs by @carlopi in #13158
* [Explain (mostly internal only)] Change the way key-value pairs of
information are stored for RenderTreeNodes by @Tishj in #13109
* Fixup invocation of clang-tidy by @carlopi in #13216
* [Julia] fix Vector and DataChunk all_valid() checks by @aplavin in #13210
* Fix broken explain (format json) test by @Mytherin in #13218
* Linux 32: avoid packaging Jemalloc, due to regression by @carlopi in #13156
* feat(c): create value support by @Mytherin in #13203
* feat(c): create value support by @Mause in #12140
* fix: 13077: use tmp file for secret writes by @devanbenz in #13170
* Filter paths before scripts/clang-tidy-diff.py by @carlopi in #13220
* [CSV Reader/Progress Bar] Fixes by @pdet in #13207
* Use poll in httplib by @Mytherin in #13223
* Fix several fuzzer issues by @Mytherin in #13240
* Fix #13238 - cannot return constant vector for volatile functions with more
than one row as input by @Mytherin in #13241
* Rename FORCE_CHECKPOINT to ALWAYS_CHECKPOINT by @Mytherin in #13242
* C API test fix - correctly use length also in non-inlined case by @Mytherin
in #13243
* Rollback optimistic writers when all rows we have inserted are deleted by
@Mytherin in #13236
* Add serialization support and fix ToString of ChangeOwnershipInfo by
@Mytherin in #13233
* Fix #13200: Transactions that update tables need to keep the underlying row
group collection alive to ensure we can safely clean-up by @Mytherin in #
13230
* [CSV Reader] Comment Option by @pdet in #13162
* Fix foreign key lookups from different search path by @ywelsch in #13256
* Add aggregate function support to the C API by @Mytherin in #13229
* Feature #1272: Window Task Blocking by @hawkfish in #13249
* Implement #4318: add overload for pg_get_constraintdef by @Mytherin in #
13258
* Several fuzzer fixes by @Mytherin in #13261
* Correctly add profiling information from finalize events to operator
timings in EXPLAIN ANALYZE by @Mytherin in #13260
* Issue #13250: Zero Time Buckets by @hawkfish in #13271
* Add delta to CI by @samansmink in #13219
* Remove outadated test that fails somehow randomly and doesn't add much by
@carlopi in #13276
* Fix casts logic by @carlopi in #13275
* Executor profiler fix by @Mytherin in #13282
* Avoid clang-tidy-diff to check Python sources or extension folder by
@carlopi in #13279
* Enable yacc stack growing by @Mytherin in #13280
* Fix #13272: correctly read signed integer stats for TIMETZ by @Mytherin in
#13283
* [Upsert] Fix crash caused by scanning an empty LocalTableStorage by @Tishj
in #13281
* Internal #2681: IEJoin Progress by @hawkfish in #13284
* Move to latest duckdb-wasm (fixing COI compilation) by @carlopi in #13257
* [DEV] CSV Tests Refactor and Sniffer decoupled of the vector size by @pdet
in #13231
* [TemporaryFileManager] Fix bug causing sizes of .block files to not be
counted towards max_temp_directory_size by @Tishj in #13278
* [CSV Reader] Properly cleanup invalid rows by @pdet in #13262
* Disable website docs CI run by @Mytherin in #13288
* Window Task Scheduling: avoid blocking tasks during GETDATA by @Mytherin in
#13290
* Fix #12582: correctly deal with empty grouping sets mixed with non-empty
ones in lateral joins/correlated subqueries by @Mytherin in #13291
* Reduce memory usage of test by @Mytherin in #13292
* Move back from handrolled checkout to GH action + skip some verification in
memory-intensive tests in CI by @carlopi in #13296
* C API extensions by @samansmink in #12682
* Secret settings cascade by @samansmink in #13167
* Fix CMake for when folders are not git folders via git rev-parse
--is-inside-work-tree by @carlopi in #13315
* [Dev] Fix breakage caused by adjusting duckdb.h directly by @Tishj in #
13321
* CAPI extensions: Fixup list of exported functions for wasm by @carlopi in #
13320
* [Python Dev] Make cursor creation threadsafe, perform compaction on the
internal vector by @Tishj in #13319
* [Dev] Make (previously implicit) assertion explicit for
DuckTransactionManager by @Tishj in #13307
* [PySpark] Fix filter type checking and isin column expression return type
by @khalidmammadov in #13294
* Fix clang-format version in CONTRIBUTING.md by @JelteF in #13324
* Expected errors 2053 by @hmeriann in #13322
* Fix #13237: fix .mode insert float column output by @flashmouse in #13308
* Add CUMULATIVE_CARDINALITY metric by @maiadegraaf in #13234
* Fuzzer #3113: Lead Lag Shift by @hawkfish in #13330
* Implemented list_extract with VectorOperations::Copy by @Maxxen in #13313
* Issue template: Fix Arrow extension link by @szarnyasg in #13333
* NO_PARTITION_COLUMNS option to skip partition writes for Parquet copy by
@ykskb in #12886
* Format Python README by @szarnyasg in #13340
* Bug/Regression fixes by @lnkuiper in #13317
* Enable unnesting lists of arrays by @Maxxen in #13342
* Limit relation has wrong relation type by @pdet in #13343
* [Dev] Remove redundant variable from SQLStatement by @Tishj in #13341
* Internal #2722: Partition State Threading by @hawkfish in #13350
* Adding hyperbolic trigonometric functions by @nickgerrets in #13346
* CSV Sniffer - Error Messages by @pdet in #13355
* Fix a typo by @SYaoJun in #13360
* Add PySpark head, take and first functions by @khalidmammadov in #13349
* [Explain] Add the GRAPHVIZ format for EXPLAIN statements by @Tishj in #
13201
* Time cast: Have same behavior as Postgres by @pdet in #13267
* Fix reordering semi joins by @Tmonster in #13335
* Fix appian join tests by @Tmonster in #13356
* remove sqlsmith patch by @Tmonster in #13334
* Support Json Types in CSV Reader by @pdet in #13359
* [CSV Sniffer] Date/Timestamp Sniffing adjustment by @pdet in #13168
* WAL: Write pointers to optimistically written row groups directly, instead
of copying over the data by @Mytherin in #13372
* [Metrics] Add CUMULATIVE_ROWS_SCANNED and OPERATOR_ROWS_SCANNED by
@maiadegraaf in #13354
* [Transformer] Fix loss of named parameter data in recursive
TransformStatement calls by @Tishj in #13344
* Feature #1272: Window Distinct Merging by @hawkfish in #13329
* Refine heuristic for flipping join sides by @lnkuiper in #13399
* Update jemalloc and re-enable opt.retain by @lnkuiper in #13370
* Add native list_has_all implementation by @Maxxen in #13401
* Feature #1272: Window Distinct Indices by @hawkfish in #13394
* [Arrow] Support consuming an "arrow_array_stream" PyCapsule by \
@Tishj in #
13386
* Sample at least one value for the hyperloglog by @Tmonster in #13383
* Fix issues with JSON map inference by @lnkuiper in #13387
* Compressed materialization for joins by @lnkuiper in #13402
* Python installation: Recommend using pip by @szarnyasg in #13357
* [Python UDF] Filter NULL values before calling the user defined function by
@Tishj in #13358
* Add support for scalar function overloads to the C API by @Mytherin in #
13409
* Fix unused variable, resolve warning turned error in the amalgamation CI by
@carlopi in #13408
* Add support for aggregate function overloads to the C API by @Mytherin in #
13410
* Fix lossy double cast issue by @lnkuiper in #13411
* Buffer manager: set handle readers after I/O so that any I/O exceptions
don't leave the readers with an invalid value by @Mytherin in #13417
* fix undefined symbol in httpfs for python by @cyberjunk in #13420
* Fix dsdgen args by @Tmonster in #13421
* [Arrow] Support producing an "arrow_array_stream" PyCapsule by \
@Tishj in #
13418
* Disable jemalloc on 32bit through cmake, not through a CI script by
@lnkuiper in #13433
* allow changing the default persistent secret storage after initialization
by @samansmink in #13434
* Fixing hugeint cast to varint by @pdet in #13268
* [Explain] Add the HTML format for EXPLAIN statements by @Tishj in #13202
* fix for the issue 2698 by @hmeriann in #13440
* Avoid rounding errors and simplify memory assignments in
TemporaryMemoryManager by @lnkuiper in #13439
* Pull up filters from and through explicit joins by @lnkuiper in #13431
* [Metadata] Populate the expressions column of duckdb_indexes by @Tishj in #
13415
* Use LossyNumericCast while reading memory limits by @carlopi in #13450
* Label timestampTZ to timestamp cast as not revertible by @Tmonster in #
13206
* Prevent the query thread from picking up query unrelated tasks if compiled
with DUCKDB_NO_THREADS by @NiclasHaderer in #13326
* [Dev] Skip test on lower pyarrow versions by @Tishj in #13463
* Add TPCDS sf-100 benchmarks by @hmeriann in #13205
* [Python] Let create_function cancel an open transaction instead of failing
by @Tishj in #13462
* [Dev] Mention non-unique indexes in UPSERT DO UPDATE SET error by @Tishj in
#13465
* Issue #13380: IN Invertible Casts by @hawkfish in #13441
* Compilation Fixes for GCC 4.8 by @hannes in #13474
* [Dev] Make Binder::Binder a private constructor by @Tishj in #13475
* [Arrow] Accept objects that provide the __arrow_c_stream__ producer method
by @Tishj in #13425
* [Lambdas] Support N-ary lambdas in the list comprehension syntax by @Tishj
in #13389
* [METRICS] Add blocked_thread_time Metric by @maiadegraaf in #13430
* Add ifdef to allow generating code with newer versions of Bison by
@Mytherin in #13477
* Clean up rendered text trees by @Mytherin in #13476
* Make CMake target exports relocatable by @cryos in #13312
* Disable delta extension on windows for now by @Mytherin in #13485
* Regression runner - don't fail on HTTP error by @Mytherin in #13486
* ExecutorTask: flush before finalizing task by @Mytherin in #13482
* [Metrics] Rework Optimizer Metrics by @maiadegraaf in #13480
* Support collations in ordered aggregates by @Mytherin in #13491
* ci: minor optional cleanup for cibuildwheel config by @henryiii in #13496
* chore: remove wheel dependency by @henryiii in #13495
* Prefer depth-first plan evaluation for unions and joins by @lnkuiper in #
13447
* Fix #13472: get correct WAL location for windows long paths by @Mytherin in
#13487
* Make error message more explicit for when trying to parse SQL types. by
@pdet in #13376
* [Arrow] Add UUID and JSON extension types by @pdet in #13446
* Apply extension patches via 'patch' instead of 'git apply' by @carlopi in #
13488
* Feature #1272: Window Distinct Tree by @hawkfish in #13503
* Scalar macro default params by @Alex-Monahan in #13494
* Add Varint to AllTypes() by @pdet in #13388
* [ADBC] Support creation and ingestion into temporary tables. by @pdet in #
13426
* Add support for registering custom casts (and types) through c api by
@Maxxen in #13499
* Bump sqlite & mysql by @carlopi in #13515
* Switch floating point division and modulo to use IEEE semantics for
division by zero by default, and add ieee_floating_point_ops setting that
can be used to revert back to old behavior by @Mytherin in #13493
* [C API] Get all metrics by @taniabogatsch in #13497
* Tuning ART indexes for duplicate values by @taniabogatsch in #13373
* Feature #1272: Windowed Quantile Tree by @hawkfish in #13516
* [Auto Loading] Autoload extension settings by @Tishj in #12790
* JSON bugfixes and new functions by @lnkuiper in #13481
* Make changes to relation.hpp backward compatible with older API via default
parameters by @carlopi in #13522
* Preserve cardinality information by @jeewonhh in #13517
* Return an error when multiple rows are returned from a scalar subquery by
@Mytherin in #13514
* When referencing optimistically-written blocks in the WAL, we need to fsync
the main database file before writing the WAL to ensure all changes have
made it to disk by @Mytherin in #13526
* Remove assertion in compressed file system by @Maxxen in #13531
* Skip empty files in single-threaded CSV reader by @pdet in #13528
* Disallow ordering by non-integer literal by default - and add the setting
order_by_non_integer_literal to revert to the previous behavior by
@Mytherin in #13532
* Produce an empty list result for enum_range(NULL::enum_type) by @pdet in #
13530
* [CSV Reader] Fix for invalid unicode in header by @pdet in #13518
* Issue #13525: Window Local States by @hawkfish in #13538
* Linux32 also to regular ci by @carlopi in #13547
* Feature #1272: Windowed Distinct Tree by @hawkfish in #13527
* Bump GitHub workflows to their latest versions by @deining in #13393
* Add map_contains, map_contains_entry and map_contains_value functions,
list_position now returns null. by @Maxxen in #13406
* Numeric casts: forbid NumericCasts for float/double, add Lossy and Exact
equivalent to make syntax explicit by @carlopi in #13546
* Fix clang-tidy on insertion_order_preserving_map.hpp: Alter order of
statements by @carlopi in #13556
* Add http proxy by @samansmink in #13368
* move the inet extension out-of-tree by @chrisiou in #13085
* Fix compilation: install extension needs an instance now by @Mytherin in #
13565
* Initialize (potentially) empty buffer by @lnkuiper in #13564
* HTTP glob test fix by @Mytherin in #13563
* Remove patches (vss and substrait), bump other repositories by @carlopi in
#13551
* Disable dynamic filter pushdown for right semi joins by @Mytherin in #13562
* postgres_scanner: bump & remove patches by @carlopi in #13567
* Optimistic write to WAL: cannot write block pointers if we have in-memory
updates to transaction local storage by @Mytherin in #13577
* Add all CAPI functions to extension api for now by @samansmink in #13568
* Minor fixes for DuckDB-Wasm by @carlopi in #13566
* Fix for vector size 2 tests by @Mytherin in #13569
* [CSV Sniffer] Date Adjustment by @pdet in #13573
* Fix issues found by alternative verify by @Mytherin in #13578
* Set version info for duckdb.dll by @Giorgi in #13557
* Update storage info by @szarnyasg in #13483
* Constrain size of estimated cardinality returned when operator is not
initialized by @Mytherin in #13574
* Unify task (un)blocking in physical operators by @lnkuiper in #13559
* [CSV Reader] Fix lock issue on Global CSV Reader by @pdet in #13560
* TIMETZ group by: collations now no longer always return VARCHAR by
@Mytherin in #13571
* Internal #2850: Window Local States by @hawkfish in #13581
* Two steps upload action by @carlopi in #13582
* Use new HLL implementation in DistinctStatistics by @lnkuiper in #13489
* Remove inet from extension update test by @Mytherin in #13589
* [METRICS] Small fixes by @maiadegraaf in #13575
* Fix #13537: correctly maintain parameter count when rebinding a prepared
statement by @Mytherin in #13583
* Various nightly test fixes by @Mytherin in #13584
* IE Join: turn these into atomics to prevent tsan from tripping up in
GetProgress by @Mytherin in #13586
* Fix HTTPFS tests by @Mytherin in #13588
* [PyArrow] Fix issue with passing timestamp types to filters by @pdet in #
13593
* Fuzzer fixes by @Tmonster in #13596
* Automatically call malloc_trim to reduce unused outstanding allocations by
@lnkuiper in #13590
* Fix for joins and FSST on 32-bit configurations by @Mytherin in #13594
* Casting to Bit is no longer Invertible by @Tmonster in #13595
* Switch in-tree DuckDB extension to use DuckDB's semver tag by @samansmink
in #13591
* List has bind fix by @Maxxen in #13600
* Do not include version.rc file on MINGW by @Giorgi in #13601
* [Python RelAPI] Throw an error if trying to use a invalid argument in
read_csv by @pdet in #13597
* More nightly test fixes by @Mytherin in #13605
* Optimistic write to WAL: we cannot optimistically write block pointers if
there are indexes by @Mytherin in #13610
* Block verification run and FixedSizeBuffer fix by @taniabogatsch in #13607
* [Test] Tighter ART storage regression boundaries by @taniabogatsch in #
13612
* Disable JEMALLOC_HAVE_MADVISE_HUGE in jemalloc by @lnkuiper in #13608
* Avoid adding buffers that will be destroyed to the eviction queue by
@lnkuiper in #13606
* Track overflow strings in PartialBlockManager during optimistic write by
@Mytherin in #13618
* [Fix] Avoid index deletion after catalog exception by @taniabogatsch in #
13627
|
| 2024-08-25 08:19:21 by Thomas Klausner | Files touched by this commit (575) |
Log message: *: replace CMAKE_ARGS with CMAKE_CONFIGURE_ARGS |
New packages: