dzaima
|
3d4a31ae6f
|
access function/modifier runtime ID through macro
|
2024-10-10 02:38:17 +03:00 |
|
dzaima
|
85c5fb659d
|
more clang-friendly multi-input homMask
|
2024-10-07 02:49:58 +03:00 |
|
dzaima
|
cf19280c54
|
fix reliance on signed wrapping in replicate
|
2024-10-03 20:33:02 +03:00 |
|
dzaima
|
27b7c0746c
|
full interleave_cells
needed to make all rank-1 inputs work on non-Singeli builds, but beneficial in general anyway
|
2024-09-12 06:17:32 +03:00 |
|
dzaima
|
41785cb4bf
|
Singeli const¨⌾(m⊸/)b
|
2024-09-10 01:45:56 +03:00 |
|
dzaima
|
02573fa4eb
|
fatal{msg}
|
2024-09-10 01:45:18 +03:00 |
|
dzaima
|
b62e7cd820
|
fix generic arch build
|
2024-09-02 00:04:32 +03:00 |
|
Marshall Lochbaum
|
56cb10d6e5
|
Min/max scan that can skip unused argument vectors sometimes
|
2024-08-20 15:26:07 -04:00 |
|
dzaima
|
d185d32d9e
|
remove debug include
|
2024-08-20 17:22:10 +03:00 |
|
dzaima
|
a654bd88d2
|
fix aarch64 build
|
2024-08-17 20:13:38 +03:00 |
|
dzaima
|
3b2b9bba1a
|
AVX-512 bitwiden
|
2024-08-14 23:44:08 +03:00 |
|
dzaima
|
67626d1e49
|
a couple more AVX-512 defs
|
2024-08-14 23:44:08 +03:00 |
|
dzaima
|
6b72139d75
|
include avx512 in base
|
2024-08-14 22:13:24 +03:00 |
|
dzaima
|
60380e6270
|
fix out-of-bounds indexing in factors
|
2024-08-14 22:10:45 +03:00 |
|
Marshall Lochbaum
|
b2566c8f3a
|
NEON k/bool support
|
2024-08-14 14:51:01 -04:00 |
|
Marshall Lochbaum
|
b801c7c186
|
Move to dedicated k/bool loops for k=5,7 and at least SSSE3
|
2024-08-14 14:51:01 -04:00 |
|
Marshall Lochbaum
|
b2758d355c
|
k/bool cleanup and implementation comments
|
2024-08-14 14:51:01 -04:00 |
|
Marshall Lochbaum
|
bf69705c82
|
Factor (8×k)/bool as bit-replicate, then byte-replicate
|
2024-08-14 10:30:26 -04:00 |
|
Marshall Lochbaum
|
fc1265b3f2
|
Enable (non-boolean) constrep on SSSE3
|
2024-08-14 10:30:26 -04:00 |
|
Marshall Lochbaum
|
048529740b
|
SSE2 k/bool where k divides 8 implementations
|
2024-08-14 10:30:26 -04:00 |
|
Marshall Lochbaum
|
ee27717c97
|
SSE2 odd/bool implementation using [4]u32 shuffles
|
2024-08-14 10:30:26 -04:00 |
|
Marshall Lochbaum
|
36e9ca5814
|
Extend odd/bool SSSE3 code to support AVX2
|
2024-08-14 10:30:26 -04:00 |
|
Marshall Lochbaum
|
2be022921e
|
Combine generic and SSSE3 general-case odd/bool, so SSSE3 uses mask unpacking
|
2024-08-14 10:30:26 -04:00 |
|
Marshall Lochbaum
|
3e5dbdbf8d
|
Dedicated generic k/bool for divisors of 8; factor; remove pdep emulation
|
2024-08-14 10:30:26 -04:00 |
|
Marshall Lochbaum
|
13ec029d9f
|
Get odd k/bool carry by shifting in the unified register, not after masking
|
2024-08-14 10:30:26 -04:00 |
|
Marshall Lochbaum
|
1621c7d07c
|
Generic-arch k/bool algorithm for odd k with mask unpacking
|
2024-08-14 10:30:26 -04:00 |
|
Marshall Lochbaum
|
7d7d36b354
|
Extend SSSE3 k/bool to k<32 using pairwise swaps
|
2024-08-14 10:30:26 -04:00 |
|
Marshall Lochbaum
|
696a23af9e
|
Mask off last k/bool vector properly
|
2024-08-14 10:30:26 -04:00 |
|
Marshall Lochbaum
|
1a4cada0cb
|
AVX2 support in rep_const_bool_ssse3_div8
|
2024-08-14 10:30:26 -04:00 |
|
Marshall Lochbaum
|
b4d84041bc
|
Extend odd k/bool SSSE3 algorithm to k<16, factor even k≤32
|
2024-08-14 10:30:26 -04:00 |
|
Marshall Lochbaum
|
a439a0a430
|
SSSE3 k/bool for 2≤k≤8, k≠6
|
2024-08-14 10:30:26 -04:00 |
|
Marshall Lochbaum
|
a4b6d8d827
|
SSSE3 3/bool, faster than BMI2
|
2024-08-14 10:30:26 -04:00 |
|
Marshall Lochbaum
|
7f6c401eb3
|
Generic-architecture k/bool for small 8<k
|
2024-08-14 10:30:26 -04:00 |
|
Marshall Lochbaum
|
0602927b17
|
Move pdep-based k/bool code to Singeli
|
2024-08-14 10:30:26 -04:00 |
|
dzaima
|
fc800ee191
|
remove debug include
|
2024-08-14 15:06:43 +03:00 |
|
dzaima
|
9b515c3fad
|
reverse pointer arguments of copy.singeli exports
|
2024-08-14 05:18:13 +03:00 |
|
dzaima
|
f6c52ef3b3
|
disable Singeli bitwiden on SSE2
|
2024-08-14 05:18:13 +03:00 |
|
dzaima
|
f356ba0f36
|
more definitions in base.singeli
|
2024-08-14 05:18:13 +03:00 |
|
dzaima
|
3fc92eceaa
|
include util/tup in base.singeli
|
2024-08-14 05:18:13 +03:00 |
|
dzaima
|
eccbac37ab
|
aarch64 8→n bitnarrow
|
2024-08-14 05:18:13 +03:00 |
|
dzaima
|
c72ed51149
|
Singeli n→8 bitwiden
|
2024-08-14 05:18:13 +03:00 |
|
dzaima
|
f36cefc9ac
|
more Singeli utils
|
2024-08-14 05:18:13 +03:00 |
|
dzaima
|
5748833060
|
fast inds⊸⊏˘bits for ≤8-bit input & output cells
|
2024-08-14 05:18:13 +03:00 |
|
dzaima
|
081b928cb4
|
fix zip_halves being weird
|
2024-07-28 05:10:46 +03:00 |
|
dzaima
|
ffc250eb0e
|
clearer aarch64 zip_halves mzip usage
|
2024-07-28 04:02:54 +03:00 |
|
dzaima
|
bd3789963c
|
these are actually good
|
2024-07-28 02:52:58 +03:00 |
|
dzaima
|
6f25e76e5d
|
tune NEON inds⊸⊏˘f64arr
|
2024-07-28 02:47:12 +03:00 |
|
dzaima
|
93fca7c628
|
fix overflow in index widening
|
2024-07-26 22:17:49 +03:00 |
|
dzaima
|
7cc1031f70
|
use outside-of-loop index widening on aarch64
slower as-is due to reduced supported ranges, but that's not an inherent restriction
|
2024-07-26 22:17:49 +03:00 |
|
dzaima
|
69ca524251
|
widen inds outside select-cells loops
|
2024-07-26 22:17:49 +03:00 |
|