Commit Graph

3018 Commits

Author SHA1 Message Date
dzaima
732f52630a use AVX-512 integer narrow if available 2025-04-24 00:00:32 +03:00
dzaima
528fea645a nicer store-low in bins.singeli
also means it doesn't break on width>256
2025-04-23 22:58:58 +03:00
dzaima
78359afc71 move x86 int widen into x86.singeli
+ AVX-512 defs for it & (undef|zero)_promote; + add extract{V, x:V0, k}
2025-04-03 03:53:31 +03:00
dzaima
dbe97cf0e0 move some basic things into x86.singeli 2025-04-03 03:53:25 +03:00
dzaima
5928bd91bc note problematic latency of dpbusd/dpwssd 2025-04-03 00:37:11 +03:00
dzaima
63b7fab72c better w+x & w-x overflow checks 2025-03-26 04:16:38 +02:00
dzaima
09642a354f do reqsz != (size_t) reqsz check in NO_MMAP builds too 2025-03-24 18:12:55 +02:00
dzaima
68a969b417 get clang to do less horrible codegen for index calculations
the do-while loop isn't actually necessary, just moving the unr offset is enough, but I'm doing it anyway
2025-03-24 18:12:55 +02:00
dzaima
ad73e075e0 unroll bitwise arith 2025-03-24 18:12:55 +02:00
dzaima
e3239d29bd enable 32-byte alignment for array data 2025-03-24 18:12:55 +02:00
dzaima
60b848f1b7 don't require strict subset type for trunc 2025-03-22 19:09:51 +02:00
dzaima
c7632c23a2 actually, can define the x86 sadbw-using vfold for i8
it's unsigned, but that doesn't matter when just taking the low 8 bits
2025-03-22 18:21:09 +02:00
dzaima
ae29c4ad45 fix usz=32 build 2025-03-21 18:08:12 +02:00
dzaima
609f3418d8 use offset loads instead of vec_merge_shift_right for groupstat 2025-03-21 06:01:27 +02:00
dzaima
e2b4dbcf20 use any_hom / all_hom for (any|all)_accumulator 2025-03-21 06:01:27 +02:00
dzaima
05d87dd7df move groupstat to fancy accumulator 2025-03-21 06:01:26 +02:00
dzaima
97260e0051 special-cased x86 SSE2 i8 min/max accumulator 2025-03-21 04:32:26 +02:00
dzaima
f503880cc3 use fancy accumulator for getRange 2025-03-21 04:32:26 +02:00
dzaima
e1b62b95b6 fancy Singeli accumulator; use for integer sum 2025-03-21 04:32:26 +02:00
dzaima
3b1239d499 support requesting a flush every k iterations in for_mu 2025-03-21 04:32:26 +02:00
dzaima
9c2ea18e22 use x86 sad for vfold
not used by anything, but it's here
2025-03-21 04:32:26 +02:00
dzaima
6c6f6e4013 add x86 sad & madd intrinsics 2025-03-21 04:32:26 +02:00
dzaima
9876d1d622 reduce Singeli-generated C noise on constant broadcasts 2025-03-21 04:32:26 +02:00
dzaima
4a5a1fa35b a couple more baseline utilities
assert_hom to be expanded upon later
2025-03-21 01:05:53 +02:00
dzaima
87be577ff7 actually use defined is in for_mu 2025-03-20 20:27:26 +02:00
dzaima
0c2fb1a267 a bit of cleanup
still from the long-ago days when symbols couldn't be assignment targets directly
2025-03-19 01:05:22 +02:00
dzaima
577b09a062 introduce x86.singeli 2025-03-19 01:05:15 +02:00
dzaima
108379f121 fix UB shift 2025-03-16 23:47:01 +02:00
dzaima
f1021580ad silence warning on non-Singeli builds 2025-03-16 20:22:17 +02:00
dzaima
9c870ddab9 add more info in heap dump 2025-03-16 03:52:23 +02:00
dzaima
82ebd37b3f group statistics test 2025-03-13 23:36:02 +02:00
Marshall Lochbaum
233c88120d Singeli function for initial group statistics pass since auto-vectorization isn't great 2025-03-13 14:21:38 -04:00
dzaima
72c4eca6c0 fix float ⌾(l⊸⊏) doing wrong comparisons 2025-03-12 17:23:17 +02:00
dzaima
d48194c3c8 fix comment 2025-03-12 17:20:18 +02:00
dzaima
7a412523dd better SSE2 float getRange 2025-03-12 16:38:20 +02:00
dzaima
62b095be89 oneElt⊏𝕩 improvements & fixes 2025-03-12 06:29:26 +02:00
dzaima
3ae7d134d2 more uniform F¨ fill behavior 2025-03-12 05:52:52 +02:00
dzaima
a013eb094e select_fn doesn't require SIMD anymore
it's not used too much without SIMD extensions available, but it is used a bit
2025-03-12 04:20:53 +02:00
dzaima
bfce527096 fix 𝕗⌾(-2⋆63)𝕩 2025-03-12 03:01:11 +02:00
dzaima
e33b3b95ee relax documented RangeFn behavior to align with NEON impl 2025-03-12 02:10:05 +02:00
dzaima
a6202c8ca6 fix error message of ⌾(oob⊸⊏) 2025-03-12 01:41:52 +02:00
dzaima
0848faf8c7 don't leak memory in TEST_RANGE 2025-03-12 01:14:24 +02:00
dzaima
5f5bb37a92 fix builtin function comparison on ALL_R1 2025-03-12 01:03:00 +02:00
dzaima
d2ca600e02 actually make try_first_hom return things 2025-03-12 00:20:49 +02:00
dzaima
85ef1038b8 fix usz=32 build 2025-03-11 23:41:11 +02:00
Marshall Lochbaum
dcecc70c25 More careful fill handling with characters in insert_scal 2025-03-10 21:58:15 -04:00
dzaima
97e0210c41 remove unnecessary F˜˘ acceptance from F˘
scan_rows_bit only checks frtid, which is 0 for such
2025-03-11 00:17:11 +02:00
dzaima
bcf32838f4 some more ˝ tests, use COPY_TO
not much of a difference, but prettier
2025-03-11 00:15:45 +02:00
Marshall Lochbaum
f1972fc408 Faster stride-1 check 2025-03-10 12:57:25 -04:00
Marshall Lochbaum
e42273bfe8 Generic stride-1 𝔽`˘ implementation 2025-03-10 12:50:54 -04:00