dzaima
|
60380e6270
|
fix out-of-bounds indexing in factors
|
2024-08-14 22:10:45 +03:00 |
|
Marshall Lochbaum
|
b2566c8f3a
|
NEON k/bool support
|
2024-08-14 14:51:01 -04:00 |
|
Marshall Lochbaum
|
b801c7c186
|
Move to dedicated k/bool loops for k=5,7 and at least SSSE3
|
2024-08-14 14:51:01 -04:00 |
|
Marshall Lochbaum
|
b2758d355c
|
k/bool cleanup and implementation comments
|
2024-08-14 14:51:01 -04:00 |
|
Marshall Lochbaum
|
bf69705c82
|
Factor (8×k)/bool as bit-replicate, then byte-replicate
|
2024-08-14 10:30:26 -04:00 |
|
Marshall Lochbaum
|
fc1265b3f2
|
Enable (non-boolean) constrep on SSSE3
|
2024-08-14 10:30:26 -04:00 |
|
Marshall Lochbaum
|
048529740b
|
SSE2 k/bool where k divides 8 implementations
|
2024-08-14 10:30:26 -04:00 |
|
Marshall Lochbaum
|
ee27717c97
|
SSE2 odd/bool implementation using [4]u32 shuffles
|
2024-08-14 10:30:26 -04:00 |
|
Marshall Lochbaum
|
36e9ca5814
|
Extend odd/bool SSSE3 code to support AVX2
|
2024-08-14 10:30:26 -04:00 |
|
Marshall Lochbaum
|
2be022921e
|
Combine generic and SSSE3 general-case odd/bool, so SSSE3 uses mask unpacking
|
2024-08-14 10:30:26 -04:00 |
|
Marshall Lochbaum
|
3e5dbdbf8d
|
Dedicated generic k/bool for divisors of 8; factor; remove pdep emulation
|
2024-08-14 10:30:26 -04:00 |
|
Marshall Lochbaum
|
13ec029d9f
|
Get odd k/bool carry by shifting in the unified register, not after masking
|
2024-08-14 10:30:26 -04:00 |
|
Marshall Lochbaum
|
1621c7d07c
|
Generic-arch k/bool algorithm for odd k with mask unpacking
|
2024-08-14 10:30:26 -04:00 |
|
Marshall Lochbaum
|
7d7d36b354
|
Extend SSSE3 k/bool to k<32 using pairwise swaps
|
2024-08-14 10:30:26 -04:00 |
|
Marshall Lochbaum
|
696a23af9e
|
Mask off last k/bool vector properly
|
2024-08-14 10:30:26 -04:00 |
|
Marshall Lochbaum
|
1a4cada0cb
|
AVX2 support in rep_const_bool_ssse3_div8
|
2024-08-14 10:30:26 -04:00 |
|
Marshall Lochbaum
|
b4d84041bc
|
Extend odd k/bool SSSE3 algorithm to k<16, factor even k≤32
|
2024-08-14 10:30:26 -04:00 |
|
Marshall Lochbaum
|
a439a0a430
|
SSSE3 k/bool for 2≤k≤8, k≠6
|
2024-08-14 10:30:26 -04:00 |
|
Marshall Lochbaum
|
a4b6d8d827
|
SSSE3 3/bool, faster than BMI2
|
2024-08-14 10:30:26 -04:00 |
|
Marshall Lochbaum
|
7f6c401eb3
|
Generic-architecture k/bool for small 8<k
|
2024-08-14 10:30:26 -04:00 |
|
Marshall Lochbaum
|
0602927b17
|
Move pdep-based k/bool code to Singeli
|
2024-08-14 10:30:26 -04:00 |
|
dzaima
|
fc800ee191
|
remove debug include
|
2024-08-14 15:06:43 +03:00 |
|
dzaima
|
9b515c3fad
|
reverse pointer arguments of copy.singeli exports
|
2024-08-14 05:18:13 +03:00 |
|
dzaima
|
f6c52ef3b3
|
disable Singeli bitwiden on SSE2
|
2024-08-14 05:18:13 +03:00 |
|
dzaima
|
f356ba0f36
|
more definitions in base.singeli
|
2024-08-14 05:18:13 +03:00 |
|
dzaima
|
3fc92eceaa
|
include util/tup in base.singeli
|
2024-08-14 05:18:13 +03:00 |
|
dzaima
|
eccbac37ab
|
aarch64 8→n bitnarrow
|
2024-08-14 05:18:13 +03:00 |
|
dzaima
|
c72ed51149
|
Singeli n→8 bitwiden
|
2024-08-14 05:18:13 +03:00 |
|
dzaima
|
f36cefc9ac
|
more Singeli utils
|
2024-08-14 05:18:13 +03:00 |
|
dzaima
|
5748833060
|
fast inds⊸⊏˘bits for ≤8-bit input & output cells
|
2024-08-14 05:18:13 +03:00 |
|
dzaima
|
081b928cb4
|
fix zip_halves being weird
|
2024-07-28 05:10:46 +03:00 |
|
dzaima
|
ffc250eb0e
|
clearer aarch64 zip_halves mzip usage
|
2024-07-28 04:02:54 +03:00 |
|
dzaima
|
bd3789963c
|
these are actually good
|
2024-07-28 02:52:58 +03:00 |
|
dzaima
|
6f25e76e5d
|
tune NEON inds⊸⊏˘f64arr
|
2024-07-28 02:47:12 +03:00 |
|
dzaima
|
93fca7c628
|
fix overflow in index widening
|
2024-07-26 22:17:49 +03:00 |
|
dzaima
|
7cc1031f70
|
use outside-of-loop index widening on aarch64
slower as-is due to reduced supported ranges, but that's not an inherent restriction
|
2024-07-26 22:17:49 +03:00 |
|
dzaima
|
69ca524251
|
widen inds outside select-cells loops
|
2024-07-26 22:17:49 +03:00 |
|
dzaima
|
90646563a0
|
don't use zip method for select-cells
|
2024-07-26 22:16:23 +03:00 |
|
dzaima
|
4a874710c7
|
allow unhandled types for select_rows
|
2024-07-26 22:16:23 +03:00 |
|
dzaima
|
478c389c4b
|
fast inds⊸⊏˘ mat
|
2024-07-26 22:16:23 +03:00 |
|
dzaima
|
f7dd900b3a
|
faster 𝕨⊏𝕩, incl. aarch64 support
|
2024-07-26 00:01:54 +03:00 |
|
dzaima
|
d6483a93d3
|
x86 unzip & unzip128
|
2024-07-26 00:01:54 +03:00 |
|
dzaima
|
2ed06e0db6
|
get_range Singeli binding
|
2024-07-26 00:01:54 +03:00 |
|
dzaima
|
2ca488dd66
|
aarch64 bool128 select
|
2024-07-26 00:01:54 +03:00 |
|
dzaima
|
0d5e77766a
|
build select.singeli everywhere
|
2024-07-26 00:01:54 +03:00 |
|
dzaima
|
c274c35b1e
|
Singeli @for_blocks
|
2024-07-26 00:01:54 +03:00 |
|
dzaima
|
079d3ffe91
|
better aarch64 homMask{[16]u8,[16]u8}
|
2024-07-26 00:01:54 +03:00 |
|
dzaima
|
0b69fa84cd
|
NEON comparisons to 0
|
2024-07-26 00:01:54 +03:00 |
|
dzaima
|
c0573d602c
|
don't error on non-vector types checked by genchk
|
2024-07-26 00:01:54 +03:00 |
|
dzaima
|
2dd3798228
|
more Singeli cleanup
|
2024-07-15 00:56:02 +03:00 |
|