JPEG XL

Info

rules 57
github 35276
reddit 647

JPEG XL

tools 4225
website 1655
adoption 20712
image-compression-forum 0

General chat

welcome 3810
introduce-yourself 291
color 1414
photography 3435
other-codecs 23765
on-topic 24923
off-topic 22701

Voice Channels

General 2147

Archived

bot-spam 4380

off-topic

CrushedAsian255
2024-03-07 01:44:38
```cpp #include <stdlib.h> #include <iostream> size_t ONE_GB = 1000*1000*1000; size_t BUFFERS = 200; int main() { printf("allocating\n"); char* buf[BUFFERS]; for(int x = 0; x < BUFFERS; x++) { buf[x] = (char*)malloc(ONE_GB); } printf("done allocating\n"); printf("checking buffers\n"); for(int x = 0; x < BUFFERS; x+=64) { printf("%d: %p\n",x,buf[x]); } for(int x = 0; x < BUFFERS; x++) { printf("writing %d\n",x); memset(buf[x],69,ONE_GB); } while(true) {} } ```
kkourin
2024-03-07 01:49:08
if you're interested, try using strace and see what system calls are being made during your malloc calls
2024-03-07 01:49:21
and maybe check dmesg after crashing
Traneptora
CrushedAsian255 clang++ oomtest.cpp i also switched to 1gb allocations
2024-03-07 01:49:44
clang may have different behavior
kkourin if you're interested, try using strace and see what system calls are being made during your malloc calls
2024-03-07 01:49:54
you can do that with strace
2024-03-07 01:51:35
according to strace, it looks like it's a lot of calls to mmap and then a sigsegv
kkourin
2024-03-07 01:53:36
at what point are you getting sigsegv? it's probably null pointer dereference because one of your malloc failed
2024-03-07 01:58:24
where as TheAznCoder has all successful mallocs but hits oom while paging in pages for memset
CrushedAsian255
2024-03-07 02:17:50
No but I’m not actually OOMing as it’s all in compressed memory
2024-03-07 02:18:05
I think there’s probably a hard limit set in software
2024-03-07 02:18:10
At least in my machine
kkourin
2024-03-07 02:26:42
yeah like oom in the sense that the os is killing your program because of the memory usage
Traneptora
kkourin at what point are you getting sigsegv? it's probably null pointer dereference because one of your malloc failed
2024-03-07 04:48:49
that's the only place it could be
2024-03-07 04:48:57
malloc can't crash on sigsegv
2024-03-07 04:49:09
glibc bug notwithstanding, ofc
2024-03-07 04:50:36
Ngl, I'm tempted to write a library called eral, so the library name would be liberal.so, and conservatives get mad
2024-03-07 04:50:57
this is chaotic evil but it sounds fun
CrushedAsian255
2024-03-07 05:26:06
Siggreedyprocess
DZgas Ж
2024-03-07 03:37:47
finally, there was time to download all the metadata of art from ||rule34xxx || to create a giant "dependency" graph that does not fit into the RAM (the result of working with tags from 20 thousand art is on the screen)
2024-03-07 06:10:25
2024-03-07 07:30:59
yoochan
2024-03-07 08:09:48
A porn galaxy!
DZgas Ж
2024-03-08 09:29:21
well, the graph is not particularly useful. it is too obvious that the sound and video tags will stand close.... now I'm going to write an algorithm that will sort all artists by tags on their art. and this will be a useful graph, the similarity of artists in what they draw
2024-03-08 02:35:40
Searching for each of the 19 thousand nicknames in 2 GB of RAM TAGS is a very long time (there are still 8 hours left) - I even rewrote the code in JAVA instead of Python - it accelerated code dozen times. Here is a picture of the distribution of the first nicknames in alphabetical order by tags (5% of all nicknames)
2024-03-08 05:35:46
graphviz dot 170 megabyte file is ready
yoochan
2024-03-08 06:07:23
😅
DZgas Ж
2024-03-08 06:08:57
I know of only one software (which is easy to use) that can work with graphs of this size, it is Gephi
2024-03-08 06:16:11
well... 🧐 it's really a problem to display it all...
2024-03-08 06:46:06
The garbage has been removed 2,700 artists are sorting based on 500 tags r34map incoming
2024-03-08 06:52:26
funny view of atrists collaboration
2024-03-08 07:12:49
<:monkaMega:809252622900789269>
2024-03-08 07:16:38
It's really something gigantic... I plan to make JPEG 16k x 16k - the maximum possible for viewing in a browser
2024-03-08 09:24:47
packaging problem has been solved
2024-03-08 09:35:54
yoochan A porn galaxy!
2024-03-08 10:31:47
now matrix
Nova Aurora
DZgas Ж Searching for each of the 19 thousand nicknames in 2 GB of RAM TAGS is a very long time (there are still 8 hours left) - I even rewrote the code in JAVA instead of Python - it accelerated code dozen times. Here is a picture of the distribution of the first nicknames in alphabetical order by tags (5% of all nicknames)
2024-03-08 10:54:32
Moving to Java to use less RAM <:Thonk:805904896879493180>
DZgas Ж
Nova Aurora Moving to Java to use less RAM <:Thonk:805904896879493180>
2024-03-08 11:10:13
more memory was used... But in general, everything fit into 4 gigabytes
2024-03-08 11:10:38
the main thing is that I did it today, not in a couple of days
Nova Aurora
2024-03-08 11:11:43
How did you not get rate limited? <:Thonk:805904896879493180>
DZgas Ж
Nova Aurora How did you not get rate limited? <:Thonk:805904896879493180>
2024-03-08 11:20:08
i do lot of limits. 1. at least 100 different tags per artist 2. at least 100 requests to the tag from 100 different artists 3. Each artist has a maximum of 100 tags (top100) to linking 700 thousand (10% of rule 34 xxx) artworks with a rating above 100 (for 2023-2024, and more than 500 in the entire history of rule 34 xxx) FINALLY I got 1.5k artists sorted by 0.5k tags
2024-03-08 11:58:44
full done
2024-03-09 05:17:29
spider-mario
2024-03-09 09:59:58
https://sami.boo/post/statistics/population-level-differences/
Traneptora
Nova Aurora Moving to Java to use less RAM <:Thonk:805904896879493180>
2024-03-09 10:13:14
Java should be more performant than python
sklwmp
2024-03-09 01:54:38
https://martinheinz.dev/blog/109 `git sparse-checkout` finally solves the problem of downloading just one subdirectory from a huge repo...
fab
2024-03-11 02:56:04
https://www.hdblog.it/mercato/articoli/n579286/telegram-900-milioni-utenti/
2024-03-11 02:56:45
Also I did Berlusconi birthday in matteo Salvini meta in av01
2024-03-11 02:56:52
I was able to do
2024-03-11 02:56:59
Probably not legal
2024-03-11 02:57:14
But my Facebook triggered an av1 encode
DZgas Ж
2024-03-11 06:16:37
My work - Translate from google. How to properly slow down or speed up a music track: This is done by shifting semitones or tones to preserve musical harmonics . You can't just speed up/slow down to any frequency and get good sound . This is done according to the formula: `Frequency × (2^(semitone ÷ 12 )) Frequency * (2 ** (semitone / 12))` 44100 hertz +2 semitones = 49500 This method uses "modern" music standards of 7 notes by 12 semitones or 7/12 After studying the topic, I found out that this method has an error for the sake of simplifying musical instruments and working with music in general. But in our time this means that the error in octave frequency shift is ~0.2%. It should be completely unnoticeable, but I got to the bottom of it and wrote a program to calculate the best ratio of fractions to approach an irrational number. As soon as I reached the limit in INT64, I entered the last best number into the search and - all this has already been calculated, but who knows where. https://en.xen.wiki/w/User:Xenoindex/Extended_Approximations_of_3/2 And instead of K=7 N=12 I took the ratios K=22885686008 N=39123338641 Next you need to change the formula: `Frequency × (2^(semitone × K ÷ 7 ÷ N)) Frequency * (2 ** (semitone * K / 7 / N))` Here are the pre-calculated frequencies to which you need to slow down or speed up the sound: For 44100 34980 -4 semitones 37066 -3 39276 -2 41618 -1 46730 +1 49516 +2 52470 +3 55598 +4 (Nightcore) For 48000 34979 -4 40344 -3 42750 -2 45298 -1 50862 +1 53896 +2 57110 +3 60516 +4 Ideal shift frequencies will always be fractional. But to get the perfect paranoia-placebo shift, you need to resample the music to a frequency of 384,000 hertz, calculate using the formula how many tones you need to shift relative to this frequency. Then slow down/speed up to the frequency given by the formula, rounding to an even number. And resample the resulting result using the SoX library back to 44.1/48
2024-03-11 06:19:48
GENERAL LINKS https://en.wikipedia.org/wiki/Transposition_(music) https://en.wikipedia.org/wiki/Equal_temperament Otner https://en.wikipedia.org/wiki/Semitone https://en.wikipedia.org/wiki/Major_second https://en.wikipedia.org/wiki/Harmonic http://mathemlib.ru/books/item/f00/s00/z0000011/st012.shtml
2024-03-11 06:20:18
fab
2024-03-11 06:47:59
<@224363555074342912>
2024-03-11 06:48:11
I have some original content myself
2024-03-11 06:48:49
Proof that it wasn't true that my content aren't wrong value but probably not useful to most people
DZgas Ж
DZgas Ж full done
2024-03-11 11:02:54
circular variant of the porn map
Lock
2024-03-11 11:13:21
spot your guys' fav thing
2024-03-11 11:16:11
wait
2024-03-11 11:16:22
i thought this was a different server ngl 💀
2024-03-11 11:18:16
if anyone wants to know the joke was league
DZgas Ж
2024-03-11 11:18:46
<:PepeOK:805388754545934396> <:JXL:805850130203934781> we all know what JXL is created for - to save even more porn on our computers
Traneptora
2024-03-11 11:28:47
it may be a consequence of it
2024-03-11 11:28:59
I already have my art folder converted to JXL (although it's SFW art)
DZgas Ж
2024-03-12 08:16:58
I made remake of the meme
fab
2024-03-12 10:29:35
spider-mario
2024-03-12 02:43:43
wow, someone on the internet just said: > All of your points are correct, my apologies.
2024-03-12 02:43:47
you don’t see that every day
jonnyawsom3
2024-03-12 03:03:02
Admitting you're wrong is hard, admitting someone else is right is even harder :P
Traneptora
2024-03-12 05:43:58
"It's much easier to forgive someone for being wrong than it is to forgive someone for being right."
Quackdoc
spider-mario wow, someone on the internet just said: > All of your points are correct, my apologies.
2024-03-12 07:10:07
There are two kinds of people who say wrong stuff on the internet. The first kind is people just pulling crap out of their ass. The second kind is people who want to learn so they pull something crap out of their ass. That way someone comes along and corrects it for then. its free research.
Traneptora
Quackdoc There are two kinds of people who say wrong stuff on the internet. The first kind is people just pulling crap out of their ass. The second kind is people who want to learn so they pull something crap out of their ass. That way someone comes along and corrects it for then. its free research.
2024-03-12 09:07:33
eh, sometimes people are just genuinely misinformed
2024-03-12 09:08:19
have you ever heard about that time ford, the auto manufacturer, covered up the ford pinto fire issue because it was cheaper to pay for wrongful death lawsuits than it was to recall the car? it's a commonly cited thing, but it never actually happened
2024-03-12 09:08:36
and I'm pretty sure most people who say so believe it did happen because they were misinformed
2024-03-12 09:13:09
for example, there was no "internal memo," it was a memo submitted to the federal regulation authority
2024-03-12 09:13:14
and was public record
2024-03-12 09:13:37
it used assumptions and procedures that were standard and ordinary at the time it was published
2024-03-12 09:13:42
and well within the government regulations
fab
2024-03-13 05:01:21
https://www.facebook.com/share/v/qivgMwJSUm9ikrFN/
2024-03-13 05:01:35
Luca Parmitano how to wash hair in the space
2024-03-13 05:04:58
I had tuned gg sans font to jon sneyers standard
kdx
Admitting you're wrong is hard, admitting someone else is right is even harder :P
2024-03-13 06:20:55
you're right
sklwmp
2024-03-13 10:41:38
https://itsfoss.com/upt/
Traneptora
2024-03-13 11:09:01
Something something 15 competing standards
2024-03-13 11:10:22
tho it's a bit weird that they mentiom yum
2024-03-13 11:10:37
since yum is deprecated. fedora uses dnf
spider-mario
Traneptora tho it's a bit weird that they mentiom yum
2024-03-14 09:20:58
I mean, they also call Arch’s package manager “packman”
2024-03-14 09:21:05
to which an acquaintance of mine reacted with:
2024-03-14 09:21:07
Traneptora
2024-03-14 09:39:26
lmao
spider-mario
2024-03-14 09:47:37
also ```irc <zopieux> nix-env on NixOS, <zopieux> non that's not how it works stop it get help ```
sklwmp
2024-03-14 09:54:43
"CPP" environment variable
Traneptora
2024-03-14 10:08:05
generally speaking this is an impossible problem though
2024-03-14 10:08:12
as not every package manager has the same functionality
spider-mario
2024-03-14 10:08:28
or package splitting, not just naming
2024-03-14 10:08:49
e.g. on Arch, splitting libraries into runtime vs. dev is the exception (boost) rather than the norm
Traneptora
2024-03-14 10:10:44
for example, `pacman -Rn` has no equivalent in dnf
2024-03-14 10:11:49
also `dnf remove` automatically does a cascade remove. it removes a package and everything that depends on it
2024-03-14 10:12:01
`pacman -R` won't do a cascade remove unless you do `pacman -Rc`
2024-03-14 10:12:10
it will just refuse and fail if something depends
Nova Aurora
fab
2024-03-14 06:53:40
What is the difference between this and the GG Sans you've sent earlier?
fab
2024-03-14 07:03:12
I'm already at v45
2024-03-14 07:03:57
2024-03-14 07:04:22
V25 should be old
2024-03-15 03:52:44
Weather for wb
2024-03-17 12:27:07
2024-03-17 04:28:46
Basically loudness regulate for autism
2024-03-17 04:29:13
Anyway probably YT will switch to lyra, tabula by jyrki alajyulal
2024-03-17 04:29:30
But at least loudness now on ytm is controlled
2024-03-17 04:39:08
I've done so many work for many fonts
2024-03-17 04:39:31
Open sans open dyslexic gg sans my font 3 aka suduwe
2024-03-17 04:39:52
Jetbrains mono
2024-03-17 04:40:00
Open office mono tracked
2024-03-17 04:40:22
Enwallowify
2024-03-17 04:40:39
Use cufonfonts site
2024-03-17 04:43:05
2024-03-17 04:43:20
Enjoy work has finished
2024-03-17 04:44:54
Traneptora
2024-03-17 10:23:03
what
Fox Wizard
2024-03-18 12:56:07
<:KittyThink:1126564678835904553>
Oleksii Matiash
2024-03-18 10:12:40
Out of curiosity downloaded these archives, and all "updated" files inside are dated 2022-2023. So looks like this and all other "work" exist only in his imagination
fab
2024-03-20 07:09:17
2024-03-20 07:09:37
This is all 2024 made 8:08PM 20march
2024-03-20 07:12:40
One this isn't for sure those aren't the originals by Steven Matteson by anyway
2024-03-20 07:13:24
But an internet copy with some ascii internet metadata downloaded if you have only internet usage
2024-03-20 07:13:46
Gg sans is paid not open source
lonjil
2024-03-20 09:33:11
Irregular reminder that C is a great language ```c #include <stdio.h> int main() { switch(1) { if (0) { default: printf("this is valid and gets printed"); } } } ```
spider-mario
2024-03-20 09:54:57
in C, don’t forget the `return 0;`
2024-03-20 09:55:16
or have they made it implicit in C too?
lonjil
2024-03-20 09:58:25
In both C and C++, `main`, and just main, implicitly returns 0 if it ends without a return statement.
spider-mario
2024-03-20 10:46:10
I thought that was just C++
lonjil
2024-03-20 10:46:48
I thought it was C too
spider-mario
2024-03-20 10:47:26
random stackoverflow answer: > Yes, as of C99, reaching the } at the end of main returns 0 if the return type of main is compatible with int.
lonjil
2024-03-20 10:48:02
also I believe that if you omit the return in non-main functions, it isn't UB as long as no caller tries to read the return value :)
spider-mario
2024-03-20 10:48:38
> In C90, `main()` must have an explicit return statement at the end to avoid undefined behaviour. In C99 and newer, you may omit the return statement from `main()`.
2024-03-20 10:49:01
so they did end up bringing it to C which didn’t originally have it
yurume
lonjil Irregular reminder that C is a great language ```c #include <stdio.h> int main() { switch(1) { if (0) { default: printf("this is valid and gets printed"); } } } ```
2024-03-21 12:12:53
indeed: ```c long long n,u,m,b;main(e,r)char **r;{f\ or(;n++||(e=getchar()|32)>=0;b="ynwtsflrabg"[n%=11]-e?b:b*8+ n)for(r=b%64-25;e<47&&b;b/=8)for(n=19;n;n["1+DIY/.K430x9\ G(kC["]-42&255^b||(m+=n>15?n:n>9?m%u*~-u:~(int)r?n+ !(int)r*16:n*16,b=0))u=1ll<<6177%n--*4;printf("%llx\n",m);} ```
Traneptora
spider-mario in C, don’t forget the `return 0;`
2024-03-21 07:32:57
C99 specifies that reaching the end of main, and only main, includes an implicit return 0
spider-mario so they did end up bringing it to C which didn’t originally have it
2024-03-21 07:33:43
apparently the reason for this is that bjarn strousoup forgot the return statements at the bottom of a few of his main functions in the C++ book
2024-03-21 07:33:58
when it was pointing out that his book was noncompliant, he changed the spec, rather than issue a 2nd edition
2024-03-21 07:34:59
> It turns out this is all my fault. > > Back in the early 90s, I was exchanging emails with Stroustrup over errata of his C++ Programming Language book. I had found some new ones not currently on his list including missing return 0; statements at the end of some of his example code that used main(). He thanked me and said he would fix those examples. > > He did what he said. But rather than correcting the code, he submitted a proposal to the C++ Standards committee to make his examples legal C++! > > The proposal was accepted and from there copied to the C Standard.
yurume
2024-03-21 07:35:38
what a horror!
Traneptora
2024-03-21 07:35:59
source: a random guy on reddit who claims it's his fault
2024-03-21 07:36:00
https://www.reddit.com/r/C_Programming/comments/1ahnkjp/comment/koqk27q/
2024-03-21 07:36:24
I didn't want to make it seem more reliable than it sounds
spider-mario
2024-03-21 08:03:01
sounds like us with the jxl spec
Lock
2024-03-23 11:12:36
2024-03-23 11:12:39
woah
jonnyawsom3
2024-03-23 11:26:44
That assumes most of us get to decide
yurume
2024-03-23 11:28:28
Doesn't have "I don't take one" :p
lonjil
2024-03-23 11:33:11
I guess I could change this: ``` bindsym Print exec grim - | tee $screenshot | wl-copy ``` to uhhh something like this? ``` bindsym Print exec grim - | tee >(cjxl -d 0 -e 1 /dev/stdin $screenshot) | wl-copy ```
Traneptora
2024-03-23 11:33:43
depends on whether screenshots are frames from videos I watch in mpv by pushing `s`
2024-03-23 11:33:54
or if they are desktop screenshots
lonjil
2024-03-23 11:34:37
9/10 when I'm taking a screenshot it's to share on Discord so png is the only choice that makes sense
2024-03-23 11:35:01
actually, I think Discord properly supports webp on all platforms now? So I guess I could use lossless webp.
username
2024-03-23 11:35:33
me and another friend have been using WebPs on Discord for quite a while now
2024-03-23 11:36:52
only thing that doesn't work is animated WebPs because Discord explicitly disallows them and forces users to either use GIFs or pay money to use APNGs
jonnyawsom3
2024-03-23 11:37:40
Locking features just so we have to use more room on their servers
lonjil
2024-03-23 11:39:27
APNG is for stickers specifically, not embedded attachments, right?
username
2024-03-23 11:39:36
yeah
lonjil
2024-03-23 11:39:52
remember when they added animated emoji but didn't have a size limit
2024-03-23 11:40:34
I have the entire bee movie as a 4x8 grid of animated emoji
Traneptora
2024-03-23 11:40:36
they also used to let you upload GIF emoji with a second empty frame and it would go in the animated slot, for servers that were out of regular emoji
Lock
yurume Doesn't have "I don't take one" :p
2024-03-23 11:41:45
you're weird
lonjil I guess I could change this: ``` bindsym Print exec grim - | tee $screenshot | wl-copy ``` to uhhh something like this? ``` bindsym Print exec grim - | tee >(cjxl -d 0 -e 1 /dev/stdin $screenshot) | wl-copy ```
2024-03-23 11:52:04
what does this actually do???
2024-03-23 11:58:58
it looks just like a png when i copy it and use it lol
lonjil
Lock what does this actually do???
2024-03-23 12:14:08
`grim` takes a screenshot, and in this case, sends it to stdout. It outputs it as PNG. `tee` copies a stream to stdout and to a file of your choosing. stdout leads to `wl-copy` which just puts the PNG in your clipboard. The file tee sends to, in the first snippet, is just a name in my screenshots folder with the current date and time, so the PNG is stored there too. In the second snippet, I use `>()` notation which creates a named pipe somewhere, and then gives the path of the named pipe to the application, and connects it as the stdin of whatever program is on the inside of the parens. Which as you can see stores the image as a JXL in my screenshots directory. In both cases the clipboard ends up with a PNG in it.
Lock
2024-03-23 12:15:02
didn't mean all of it lol
2024-03-23 12:15:16
mb for not being more specific
lonjil
2024-03-23 12:20:30
one thing that kinda annoys me is that software that supports all kinds of image formats (like GIMP or Discord) and also support pasting image data from the clipboard, don't support pasting anything other than PNG.
Lock
2024-03-23 12:21:31
can you embed jxl if it's from a website?
lonjil
2024-03-23 12:21:42
what do you mean?
Lock
2024-03-23 12:21:52
it i upload a jxl to a website can it embed into discord?
lonjil
2024-03-23 12:22:20
only if the website re-encodes the image for preview
Lock
2024-03-23 12:22:33
so not jxl exclusively?
2024-03-23 12:22:49
what formats does discord embed then?
lonjil
2024-03-23 12:23:44
Presumably PNG, GIF, JPEG, and WebP.
Lock
2024-03-23 12:24:56
what is <@902036286074925096> for tho?
2024-03-23 12:25:04
does it not embed jxl?
lonjil
2024-03-23 12:25:33
It does what I said, re-encodes JXL images into something Discord supports
Lock
2024-03-23 12:25:47
what a scam lol
2024-03-23 12:26:23
thanks anyways
lonjil
2024-03-23 12:27:13
how is it a scam?
2024-03-23 12:27:15
what
Lock
2024-03-23 12:27:33
nvm
jonnyawsom3
2024-03-23 12:46:57
Can also do <https://embed.moe/https://jpegxl.info/logo.jxl>
Lock what a scam lol
2024-03-23 12:47:40
I mean, while we'd love to, we can't use a bot to rewrite the code in Discord quite yet
DZgas Ж
Lock
2024-03-23 03:39:28
I understood why android smartphones started taking JPEG screenshots instead of PNG - when opening the gallery, it is extremely difficult to instantly decode 16xPNG ~1080x1920 images. unlike Jpeg
2024-03-23 03:40:05
this was not a problem as long as the screen dimensions in pixels were 480p
2024-03-23 03:41:39
I remember 8 years ago "they" said that Jpeg was about to die..... but given the modernity, it will remain the most used format for a long time to come.
jonnyawsom3
2024-03-23 04:40:36
I realised by default my phone uses jpeg, but if I take an area screenshot then it saves as PNG, even with transparency if it's an irregular shape
spider-mario
2024-03-23 09:39:32
hey, this looks kind of <#794206087879852106>
Lock
2024-03-24 03:46:01
too late 🤷‍♀️
Fox Wizard
2024-03-24 11:25:26
My 5 years old smartphone doesn't have issues almost instantly loading 20 1440x3040 PNG screenshots in the gallery app <:KekDog:884736660376535040>
Lock
2024-03-24 02:26:15
is it really loading all of them at full res?
Quackdoc
2024-03-24 03:33:04
keep in mind most gallery apps will thumbnail pictures so you need to clean the cache to test it
2024-03-24 03:35:57
you then also have to keep in mind parallel vs sequential decoding, but probably any somewhat modern phone wouldnt have too much of an issue, my s9+ to sequentually decode 20 pngs of 7432x3877 (same png 20 times which isnt super fair because of caching and what not but good enough) has about 2s per png for a total of 44 seconds. that being said there is plenty of left over memory and cpu power so you can easily parallize some of that
DZgas Ж
2024-03-24 07:41:03
my face, when anyone tell me about my CPU 14 years old
CrushedAsian255
2024-03-24 11:28:49
i was coding in C++ and wondering why performance SUCKS, then i realised I had NO OPTIMISATIONS ON, turning on -02 sped up code by 35x
DZgas Ж
2024-03-25 04:07:31
does anyone know the algorithm for converting and displaying images with a number (with an error)? it looks like a hash function but for a "floating" image in fact, there are no sources or documentation of the main image recognition services Google Yandex TinEye saucenao therefore, if there is no such technology, I would like to make an algorithm for converting an image into a number, id, hash. to do image recognition by similarity, not on the basis of the images themselves, but on the basis of a number. i.e., image recognition by similarity whitout of the images 🥴
lonjil
2024-03-25 05:30:51
TIL that OpenZFS's kernel module contains a Lua interpreter
gb82
2024-03-25 06:12:04
CrushedAsian255
2024-03-26 12:08:34
lonjil
2024-03-26 12:13:32
Jpeg
CrushedAsian255
2024-03-26 12:17:19
Xl or 1
lonjil
2024-03-26 12:19:27
both are preferrable to avif or heic
sklwmp
DZgas Ж does anyone know the algorithm for converting and displaying images with a number (with an error)? it looks like a hash function but for a "floating" image in fact, there are no sources or documentation of the main image recognition services Google Yandex TinEye saucenao therefore, if there is no such technology, I would like to make an algorithm for converting an image into a number, id, hash. to do image recognition by similarity, not on the basis of the images themselves, but on the basis of a number. i.e., image recognition by similarity whitout of the images 🥴
2024-03-26 02:04:14
perceptual hash?
DZgas Ж
sklwmp perceptual hash?
2024-03-26 03:54:29
Yes. Absolutely. everything is well thought out.It was invented. in 1980. I'll read about it later, but the pictures show that it doesn't work exactly the way I want it to.
_wb_
2024-03-26 07:16:01
I think heic might be slightly better than avif technically, but it is a patent mess so I would choose avif. But both are better as video codecs than as still image codecs.
TheBigBadBoy - 𝙸𝚛
2024-03-26 08:12:47
*asking on JXL server if JXL is best* Surely it's a little bit biased <:KekDog:805390049033191445>
yoochan
2024-03-26 09:01:33
of course ! the poll was a joke
TheBigBadBoy - 𝙸𝚛
2024-03-26 09:21:34
and how do you do that ? 0.o
2024-03-26 09:21:48
nevermind I just found
2024-03-26 09:22:03
that's quite a nice feature
DZgas Ж
DZgas Ж does anyone know the algorithm for converting and displaying images with a number (with an error)? it looks like a hash function but for a "floating" image in fact, there are no sources or documentation of the main image recognition services Google Yandex TinEye saucenao therefore, if there is no such technology, I would like to make an algorithm for converting an image into a number, id, hash. to do image recognition by similarity, not on the basis of the images themselves, but on the basis of a number. i.e., image recognition by similarity whitout of the images 🥴
2024-03-26 10:14:21
at the moment I'm taking the sum of 31 vertical lines and the sum of 17 horizontal lines
2024-03-26 10:15:30
I recently downloaded half million artworks from rule34xxx - it was fun. but these are just thumbnails
2024-03-26 10:29:50
**fuck cloudflare **i created index.html with all the links to the images and downloaded 50 thousand images per page use chrome
2024-03-26 10:31:21
It is absolutely impossible to use any software, curl not work, wget not work, paid BIG soft like OfflineExplorer and other more you can't even execute JS in the browser for massive download (you can not download external links of images in 2024 automatically in the browser)
2024-03-26 10:31:54
So I took my hands in my hands
DZgas Ж at the moment I'm taking the sum of 31 vertical lines and the sum of 17 horizontal lines
2024-03-26 10:48:12
so well...
2024-03-26 11:18:16
so I wrote a very primitive algorithm for recognizing identical images. (Perceptual hashing) Stability: maximum compression (like jpeg q0) resizing changing the aspect ratio mirroring in all directions not strong stability: color correction brightness contrast does not work if the image was: cropped (or expanded) rotated
2024-03-26 11:20:46
I've read a lot about Perceptual hashing,but for some reason all uses it - splitting images into square blocks. I do the lines, vertical and horizontal. so I got a unique image ID of 48 bytes
2024-03-26 11:20:58
```9e5b813939210413656000699581ebd8fff8f7ece1e4d7d0bd7d1c1500141a1a23324b5a574c5f4080bed4ecfffaf2f8```
DZgas Ж so well...
2024-03-26 11:22:08
the first 17 bytes are horizontal lines. technically, its can be used without the entire hash. it works too. but accuracy suffers.
username
2024-03-26 01:17:12
<@226977230121598977> `--disable-features=SplitCacheByNetworkIsolationKey` might help with downloading in chrome since it tries to make it so that images won't get downloaded a second time if you try downloading them with JS or an extension
DZgas Ж
username <@226977230121598977> `--disable-features=SplitCacheByNetworkIsolationKey` might help with downloading in chrome since it tries to make it so that images won't get downloaded a second time if you try downloading them with JS or an extension
2024-03-26 01:18:39
the images is not loaded at all, even for the first time. instead, image open in a new tab
Nyao-chan
DZgas Ж It is absolutely impossible to use any software, curl not work, wget not work, paid BIG soft like OfflineExplorer and other more you can't even execute JS in the browser for massive download (you can not download external links of images in 2024 automatically in the browser)
2024-03-26 01:20:51
gallery-dl
DZgas Ж
Nyao-chan gallery-dl
2024-03-26 01:21:42
You won't even be able to access the site.
Nyao-chan
2024-03-26 01:21:55
I just tested it
Quackdoc
2024-03-26 01:58:51
how what? ripping from rule34xxx? I use https://github.com/FerrahWolfeh/imageboard-downloader-rs
2024-03-26 02:02:28
most booru sites don't care as long as you dont pound them by downloading a large amount of images with massive parallelization
2024-03-26 02:03:44
download 1000 images using `imageboard_downloader search -i rule34 -d 10 -l 1000 -o ./dls --id -- "-animated"` to a folder called dls with 10 parallel downloads excluding anything with the `animated` tag, you actually have to patch the app if you want more then 1k downloads at a time though, not sure why, but it is what it is
DZgas Ж
DZgas Ж so I wrote a very primitive algorithm for recognizing identical images. (Perceptual hashing) Stability: maximum compression (like jpeg q0) resizing changing the aspect ratio mirroring in all directions not strong stability: color correction brightness contrast does not work if the image was: cropped (or expanded) rotated
2024-03-26 02:19:50
creating a database for half a million images takes half an hour, the search takes about 5 seconds (on my processor with 1 thread), it art was uploaded a few years after the first one (although I did a test for the noise similarity of the results, and it worked perfectly)
2024-03-26 02:20:27
does anyone know how to access all the previews that exist in Google images? 🙂
jonnyawsom3
2024-03-26 03:50:22
With how often porn comes up as a topic for image compression, I'm surprised we don't have a PG13 emoji or similar
DZgas Ж
With how often porn comes up as a topic for image compression, I'm surprised we don't have a PG13 emoji or similar
2024-03-26 04:30:10
<:PepeOK:805388754545934396> just me one
2024-03-26 04:31:09
DZgas Ж creating a database for half a million images takes half an hour, the search takes about 5 seconds (on my processor with 1 thread), it art was uploaded a few years after the first one (although I did a test for the noise similarity of the results, and it worked perfectly)
2024-03-27 06:14:43
today I will be writing a jpeg decoder. to decode 8x8 blocks without reading the information further. because my plans are to create a database of all images on the Internet, and I have created an algorithm that does not require the presence of the entire image. I need to download only the blocks color of images, as I understand ~~1 kilobyte. only Y luma
2024-03-27 06:15:44
I will send a description of the algorithm for creating an image hash today in instruct image
DZgas Ж at the moment I'm taking the sum of 31 vertical lines and the sum of 17 horizontal lines
2024-03-27 06:17:56
I haven't come up with a better name, so the algorithm is called "31+17 id system"
DZgas Ж today I will be writing a jpeg decoder. to decode 8x8 blocks without reading the information further. because my plans are to create a database of all images on the Internet, and I have created an algorithm that does not require the presence of the entire image. I need to download only the blocks color of images, as I understand ~~1 kilobyte. only Y luma
2024-03-27 08:07:06
it's good that there are enough JPEG implementations on the Internet, so I just took one of it's and closed the decoding after reading the first values of the block... It always seemed to me. more precisely, I always thought so!... that the first values of the JPEG baseline blocks are always at the beginning of the image (not only in images with progressive decoding). But it turned out that this was not the case. Well, then the whole idea is pointless. Although it was funny
DZgas Ж does anyone know the algorithm for converting and displaying images with a number (with an error)? it looks like a hash function but for a "floating" image in fact, there are no sources or documentation of the main image recognition services Google Yandex TinEye saucenao therefore, if there is no such technology, I would like to make an algorithm for converting an image into a number, id, hash. to do image recognition by similarity, not on the basis of the images themselves, but on the basis of a number. i.e., image recognition by similarity whitout of the images 🥴
2024-03-27 10:54:15
2024-03-27 11:52:19
2024-03-27 12:30:45
_wb_
2024-03-27 03:35:05
Interesting hash function — have you compared it to other perceptual hashing methods?
Traneptora
DZgas Ж
2024-03-27 04:49:37
it looks like you're breaking a hex hash into bytes and then using a difference of bytes
2024-03-27 04:49:52
why not just take xor, and then count the bits in the result?
2024-03-27 04:50:15
this way, you end up with a bit in the lowest order byte of the hash contributing 1, whereas the bit in the higher order part of the byte contributing for 128
DZgas Ж
Traneptora why not just take xor, and then count the bits in the result?
2024-03-27 04:52:15
because this is the Value of the line, and not a separate independent value
Traneptora
2024-03-27 04:52:33
oh, then how'd you get a hexdump in the first place?
DZgas Ж
_wb_ Interesting hash function — have you compared it to other perceptual hashing methods?
2024-03-27 04:53:23
Yes. I looked at more than a dozen implementations, as well as the official OpenCV docks with Perceptual hashing. -- all bullshit
Traneptora
2024-03-27 04:53:40
cause you're doing `"".join(hex())` and then later parsing it back
2024-03-27 04:53:46
why not just, pass the list in the first place?
DZgas Ж
2024-03-27 04:53:47
I made a hash visualization
Traneptora
2024-03-27 04:54:30
as far as I understand a "percptual hash" is supposed to produce a similar output for a similar input that is only off by a few pixels
DZgas Ж
2024-03-27 04:54:32
the intersection of the lines of segments 17 and 31 (shown with smoothing the boundaries of the lines)
Traneptora
2024-03-27 04:54:42
i.e. it's designed to be locally stable
2024-03-27 04:54:48
whereas a regular hash is by design locally chaotic
DZgas Ж
DZgas Ж I made a hash visualization
2024-03-27 04:55:31
I have already assembled a team of 5 people to parse the Internet, as well as create a search site (I will do it myself)
Traneptora whereas a regular hash is by design locally chaotic
2024-03-27 04:56:01
yep
DZgas Ж I have already assembled a team of 5 people to parse the Internet, as well as create a search site (I will do it myself)
2024-03-27 04:57:42
it would be nice if there are interested people here to parse, for example, reddit
2024-03-27 04:58:26
since the created hashes (IDs) are independent, it is easy to simply add them to the database like HASH:URL
spider-mario
2024-03-27 06:31:47
Prince of Persia 2 (1993) had some catchy music
2024-03-27 06:32:32
(in context: https://youtu.be/idGpzB0g4wA?t=32m20s )
jonnyawsom3
2024-03-27 07:02:15
For some reason that reminded me, my MIDI emulation in Windows is horribly broken for some reason
2024-03-27 07:04:14
2024-03-27 07:04:47
Sounds like I have a drunk band playing in my game
Traneptora
2024-03-27 09:33:14
I'm partial to the 3D Ultra Pinball 2: Creepnight Soundtrack
2024-03-27 09:35:00
they really captured the halloween aesthetic
spider-mario
2024-03-27 10:57:39
for this kind of thing, I think I’d tend to gravitate towards some of what Alberto Gonzales did for The Smurfs’ Nightmare https://youtu.be/2E7M0fUDcnU?list=PLDL64W9EXILGr59rWaLqm34Wn4yPLZwdJ
2024-03-27 10:58:42
(track 5, “Hidden Around”, may be a bit more Halloween-like)
2024-03-27 10:59:57
(updated the link to a higher-quality version)
2024-03-27 11:12:14
this one is also an impressive piece: https://youtu.be/ZXlpzbIl1Bg
diskorduser
2024-03-30 05:42:33
https://youtu.be/d6iQrh2TK98?si=uOp2oqRd_8hR1t18
sinc
2024-03-30 09:42:55
is there a release or binary or something for the *original* ssimulacra? I'm having opencv config issues that I don't want to fix 🙂
2024-03-30 09:43:21
https://github.com/cloudinary/ssimulacra
spider-mario
sinc is there a release or binary or something for the *original* ssimulacra? I'm having opencv config issues that I don't want to fix 🙂
2024-03-30 09:58:27
does this fix them? https://aur.archlinux.org/cgit/aur.git/tree/opencv4.patch?h=ssimulacra
sinc
spider-mario does this fix them? https://aur.archlinux.org/cgit/aur.git/tree/opencv4.patch?h=ssimulacra
2024-03-30 10:02:54
yes, thanks a bunch
jonnyawsom3
2024-03-31 10:50:11
I think Fab is going a little overboard again lately...
Quackdoc
2024-03-31 10:54:27
and this is why I have him blocked
2024-04-01 02:15:21
he was actually kicked out from the av1 server for the constant spam and pinging
2024-04-01 02:15:32
also you good sir have my thanks
w
2024-04-02 03:53:14
mods don't care quality of the server plummeting
diskorduser
2024-04-02 05:24:49
https://youtu.be/XkSrlZLtTbE
sklwmp
2024-04-05 11:50:03
any good VPS recommendations, preferably with locations in Asia for latency purposes? i'd try Hetzner, but they don't have Asia locations idk if i can trust Vultr after the whole ToS fiasco Linode rejects my account immediately for some reason... and idk if i trust those random small VPS providers, i want something a bit more reliable and hopefully with decent CS, what's your experiences?
Fox Wizard
2024-04-06 07:02:57
<@693503208726986763> thank you for infecting me with the urge to mega optimize jpegs and turning my PC into a space heater <:KekDog:884736660376535040>
TheBigBadBoy - 𝙸𝚛
2024-04-06 07:21:31
I'm honored to have pleased you
2024-04-06 07:21:33
https://cdn.discordapp.com/emojis/586100936544616450.png?quality=lossless&size=48
Fox Wizard
2024-04-06 07:30:22
<:KittyOwO:1147753615054872597>
fab
DZgas Ж I made a hash visualization
2024-04-06 08:09:00
how to solve this?^
2024-04-06 08:13:05
2024-04-06 08:19:27
2024-04-06 08:19:34
ok bye,
TheBigBadBoy - 𝙸𝚛
Fox Wizard <@693503208726986763> thank you for infecting me with the urge to mega optimize jpegs and turning my PC into a space heater <:KekDog:884736660376535040>
2024-04-06 09:31:17
note that I use `-i` with that tool even if it says `Allow multiple planes per DC scan, which may improve compression (incompatible with some software)` `-i generates files that are incompatible with some software such as Photoshop and Opera <= 11.61.` I've not seen any app not supporting the output, and it compresses even better some files with that flag
Fox Wizard
TheBigBadBoy - 𝙸𝚛 note that I use `-i` with that tool even if it says `Allow multiple planes per DC scan, which may improve compression (incompatible with some software)` `-i generates files that are incompatible with some software such as Photoshop and Opera <= 11.61.` I've not seen any app not supporting the output, and it compresses even better some files with that flag
2024-04-06 09:33:09
Same here, but haven't tried if it breaks in Photoshop
2024-04-06 09:33:32
I've had many issues with Photoshop with optimized jpegs in the past, so wouldn't be surprised if it breaks compatibility
TheBigBadBoy - 𝙸𝚛
2024-04-06 09:41:45
0.o
Fox Wizard
2024-04-06 09:46:25
Wonder how much of a difference using jpegtran vs mozjpegtran makes <:thinkies:854271204411572236>
2024-04-06 09:47:11
``Optimal compression is achieved by specifying the mozjpeg version of jpegtran for the -o switch. However, mozjpeg is slower and buggy with certain scan configurations, so IJG jpegtran is recommended for the -p switch.``
lonjil
2024-04-06 09:49:13
jpeglitran when
TheBigBadBoy - 𝙸𝚛
Fox Wizard ``Optimal compression is achieved by specifying the mozjpeg version of jpegtran for the -o switch. However, mozjpeg is slower and buggy with certain scan configurations, so IJG jpegtran is recommended for the -p switch.``
2024-04-06 09:56:24
I got once a file which I got an error with: 'too many scans' or something like that I wonder if IJT would have worked, but was a bit lazy lol
TheBigBadBoy - 𝙸𝚛 note that I use `-i` with that tool even if it says `Allow multiple planes per DC scan, which may improve compression (incompatible with some software)` `-i generates files that are incompatible with some software such as Photoshop and Opera <= 11.61.` I've not seen any app not supporting the output, and it compresses even better some files with that flag
2024-04-06 09:56:39
ah shit
2024-04-06 09:56:44
I sent one big message
2024-04-06 09:56:47
while I could
2024-04-06 09:56:53
just send
2024-04-06 09:56:55
several
2024-04-06 09:56:57
small
2024-04-06 09:56:59
messages
2024-04-06 09:57:06
to reach faster level 10
2024-04-06 09:57:09
:trollhq:
Fox Wizard
2024-04-06 09:57:11
Don't go fab mode <:RaysShock:686219918030798921>
2024-04-06 09:57:20
Sadly that's not how it works lmao
2024-04-06 09:57:28
Think there's a 1 or 2 minutes cooldown
TheBigBadBoy - 𝙸𝚛
2024-04-06 09:57:34
seriously ? shit <:KekDog:805390049033191445>
Fox Wizard
Fox Wizard Wonder how much of a difference using jpegtran vs mozjpegtran makes <:thinkies:854271204411572236>
2024-04-06 09:59:21
Why am I even doing this
2024-04-06 09:59:40
Have been optimizing a few large images for the past few hours lmao
2024-04-06 09:59:50
Expected it to take long, but not this long <:KekDog:884736660376535040>
TheBigBadBoy - 𝙸𝚛
2024-04-06 10:01:17
exhaustive bruteforce 💯
Fox Wizard
2024-04-06 10:01:31
The only way to do it <:KittyUwU:1147753612529913938>
lonjil
2024-04-06 10:02:12
if someone else if paying the electric bill...
Fox Wizard
2024-04-06 10:02:57
The only problem is that I can't really use my PC while it's optimizing images <:KekDog:884736660376535040>
2024-04-06 10:03:06
Except for watching videos I guess
TheBigBadBoy - 𝙸𝚛
2024-04-06 10:04:34
just don't use all your cpu cores for optimizing JPGs lol
2024-04-06 10:04:37
you're on Linux ?
Fox Wizard
2024-04-06 10:04:45
Nope™️
TheBigBadBoy - 𝙸𝚛
2024-04-06 10:04:53
<:KekDog:805390049033191445>
Fox Wizard
2024-04-06 10:05:12
I could just use less threads, but don't want to slow it down
TheBigBadBoy - 𝙸𝚛
2024-04-06 10:05:20
on Linux I know how you could restrict cpu usage of an already-launched process
Fox Wizard
2024-04-06 10:07:12
Hm, using mozjpegtran made a decent difference
2024-04-06 10:07:44
Oh wait, nevermind. Input was the non optimized file <:KekDog:884736660376535040>
2024-04-06 10:08:07
Either something went wrong or it just didn't matter at all since the output was the same XD
DZgas Ж
fab how to solve this?^
2024-04-07 04:42:28
easy
DZgas Ж
2024-04-07 04:42:42
.
2024-04-07 04:45:18
In fact, I haven't written for a long time. but I have already typed a million images into the database.... and I no longer have time to working with it. Because I bought a ryzen 5 7600 <:H265_HEVC:805856045347242016> <:AV1:805851461774475316> <:H264_AVC:805854162079842314> <:JPEG_XL:805860709039865937> and compress time
fab
2024-04-08 12:02:41
Attention breaking chBnges libjxl encoder
2024-04-08 12:04:43
I will just continue how much i would like to wanting i don't warn you
2024-04-08 12:05:36
I think my changes are benifical for the oxygen of 99% neurotypical people and there are studies confirming that and conforming that
2024-04-08 12:05:42
So I don't question it
2024-04-08 12:05:50
Is a good change
2024-04-08 12:07:34
This likely would be allowed even in jpeg xl and people would have what they wanted and be fuery i don't care about other people priority cause i prioritize only me i'm autistic and full racist
2024-04-08 12:09:39
I'm autistic type 3 and i want this on the internet to happen than the others talking about orders especially ryssians and xrhinesse
2024-04-08 12:18:27
To be honest Id don't know anything about jxl specifications but only that
2024-04-08 12:18:29
https://www.instagram.com/p/C5f8hT0tlev/?igsh=MTNhZzg0aWpyaTdqeQ==
Fox Wizard
2024-04-08 12:27:24
Yeah, it's starting to become a bit... much. I think the spam increased after he got banned from the AV1 Discord server for off-topic spamming everywhere and it's decreasing the quality and readability of this server by a decent amount :/
fab
2024-04-08 12:38:59
Yeah you right he's a chinese flat encoded with libjxl 0.10.0
2024-04-08 12:39:27
Not perfect but I've never done those type of images in past 10 days
_wb_
2024-04-08 12:43:52
@fab I am muting you for a week, you are spamming incomprehensible messages all over all channels to the point that it becomes hard to follow the actual conversations. If it restarts like this next week, the next step will be a ban.
Demiurge
2024-04-09 12:11:48
It's impossible to follow what he's trying to say too. I really think he's a malfunctioning language model
lonjil
2024-04-09 11:14:49
new personal record: 25781 tabs open
TheBigBadBoy - 𝙸𝚛
2024-04-09 12:14:08
<:monkaMega:809252622900789269>
2024-04-09 12:14:49
currently have 912 tabs, but it took me 2 years lol
2024-04-09 12:15:11
how can you reach 26k <:KekDog:805390049033191445>
lonjil
2024-04-09 12:15:45
opening tabs
2024-04-09 12:15:48
not closing them
TheBigBadBoy - 𝙸𝚛
2024-04-09 12:16:19
oh wait did you mean like, benchmarking a browser to see at how many tabs it crashes ?
Fox Wizard
2024-04-09 12:19:34
Maybe I should take back that I called someone chaotic for having 30 tabs open <:KekDog:884736660376535040>
TheBigBadBoy - 𝙸𝚛
2024-04-09 12:31:22
on my phone tho I have only a bit more than 100 tabs iirc
username
2024-04-09 12:32:48
I'm somewhere over 12,000 rn although it would have been way higher if I hadn't lost my sessions multiple times in the past
2024-04-09 12:34:11
which reminds me of something, Firefox is removing the config option that lets you decide whether or not all tabs start loading when you restore them
2024-04-09 12:34:39
I've never had the need to change it from the default of only loading the current tab but still it's lame they are removing the option
lonjil
TheBigBadBoy - 𝙸𝚛 oh wait did you mean like, benchmarking a browser to see at how many tabs it crashes ?
2024-04-09 12:38:31
no
username
2024-04-09 12:45:08
https://i.imgur.com/IShqU5E.jpg https://i.imgur.com/XhpNeJ8.jpg
Quackdoc
2024-04-09 12:45:47
quick how much erotica can we find
lonjil
2024-04-09 12:52:23
in an effort to clean things up, I've so far closed 50 windows
Quackdoc
2024-04-09 12:58:18
this is why I use a tab manager
2024-04-09 12:58:53
when I am finally done I can just nuke the tab group im working on
username
2024-04-09 01:02:38
I kinda wanna start using Firefox's old Tab-Candy/Panorama/Tab-Groups system. there's a fork of it here that works with modern Firefox: https://github.com/117649/Tab-Groups
2024-04-09 01:08:53
here's a reallllll old video showing it back when it was in development
Nova Aurora
Fox Wizard Maybe I should take back that I called someone chaotic for having 30 tabs open <:KekDog:884736660376535040>
2024-04-09 07:11:23
Tabs stress me out
w
2024-04-09 07:12:57
bro just close them and use the history menu
2024-04-09 07:13:14
it also has a search box
lonjil
2024-04-09 07:16:17
history has a size limit
gb82
lonjil new personal record: 25781 tabs open
2024-04-11 11:25:15
LORD
Demiurge
2024-04-12 11:39:33
Yes my child?
spider-mario
2024-04-12 12:34:42
https://youtu.be/-G9U1QY4UDs > I am the Lord of Darkness
username
2024-04-13 05:32:36
https://twitter.com/archer_uwu/status/1779035120487313527
spider-mario
2024-04-13 06:22:56
I’ve been using the web client, I don’t remember exactly why
2024-04-13 06:23:22
I think maybe I was concerned that the native client wouldn’t be colour-managed
Lock
2024-04-13 06:24:01
no real downside to web honestly
2024-04-13 06:24:05
if anything it's better
Demiurge
2024-04-13 07:16:12
There is no "native client"
2024-04-13 07:16:21
The native client is just a browser
2024-04-13 07:16:26
lol
2024-04-13 07:17:33
So it's like having 2 separate browsers eating RAM instead of just 1
spider-mario
2024-04-13 07:25:03
iirc, when I looked it up, what was said to be the one advantage of the standalone app is the ability to use a global push-to-talk key (instead of only when discord has focus)
2024-04-13 07:25:09
which I didn’t care about
Quackdoc
2024-04-13 08:36:21
actual working audio on linux is nice too.
jonnyawsom3
2024-04-13 08:46:25
My friend has to use the website on their work computer and complains about the lack of noise cancellation in calls along with strange extra noise getting added somewhere along the line
Nyao-chan
2024-04-15 12:28:48
I'm archiving youtube videos. Sometimes they are available in multiple formats, like vp9 and av1. Do you know of some heuristic to tell which version has better quality, besides size? I have ~500 videos in a range where size alone is not enough to tell. Maybe some kind of AI? Or some tool to calculate metric based on edge detection, since av1 and vp9 tend to oversmooth files when there's not enough bitrate? Obviously I don't have the original file to compare so it's tricky. Histogram of the size ratios:
jonnyawsom3
2024-04-15 12:41:41
Not having a source to compare to makes it pretty hard annoyingly... I suppose one idea would be finding a keyframe, moving 1 frame along and then comparing the difference, since that should be 'clean' and then whatever bitrate they gave it to work with
Nyao-chan
2024-04-15 12:47:46
The keyframes in av1 and vp9 are not the same frames. So do you mean compare frames that are not keyframes in both? Also, once I calculate the difference, how would I, in a somewhat automated way, choose the better version?
2024-04-15 12:48:51
actually I have to check if they are the same
jonnyawsom3
2024-04-15 12:49:06
So far I'm just thinking out loud, the keyframe idea was from messing with files encoded with only 256kb/s in WebM and seeing the first frame (keyframe) immediately drop down to the bitrate
Nyao-chan
2024-04-15 12:53:54
It is actually the same
_wb_
2024-04-15 01:33:18
It would be interesting to try to come up with a way to combine several recompressed videos (that were presumably all encoded from the same original) and to make a best guess of what the original looks like. Surely there should in principle be more information available if you combine all sources than if you pick one.
Nyao-chan
2024-04-15 01:53:12
I am keeping one channel (Unus Annus) in both formats specifically in hopes something like that happens is the future
jonnyawsom3
2024-04-15 01:55:31
Good call
Nyao-chan
2024-04-15 01:56:13
especially since it's been deleted and I don't think the av1 videos are accessible anywhere. I should probably upload them to archive.org
fab
Nyao-chan I'm archiving youtube videos. Sometimes they are available in multiple formats, like vp9 and av1. Do you know of some heuristic to tell which version has better quality, besides size? I have ~500 videos in a range where size alone is not enough to tell. Maybe some kind of AI? Or some tool to calculate metric based on edge detection, since av1 and vp9 tend to oversmooth files when there's not enough bitrate? Obviously I don't have the original file to compare so it's tricky. Histogram of the size ratios:
2024-04-16 12:09:02
Vp9 is not quality if you look for 10000+ videos disfare vp009
2024-04-16 12:09:13
Bitmovin explains so well
2024-04-16 12:09:40
https://bitmovin.com/av1-4k-video-sd-bitrates
diskorduser
2024-04-17 05:27:32
https://gizmodo.com/the-quiet-danger-of-noise-canceling-headphones-1851407784
spider-mario
_wb_ @fab I am muting you for a week, you are spamming incomprehensible messages all over all channels to the point that it becomes hard to follow the actual conversations. If it restarts like this next week, the next step will be a ban.
2024-04-19 11:15:43
unfortunately, it seems to have resumed
Meow
2024-04-19 11:39:39
I'm just not smart enough to understand
_wb_
2024-04-19 12:04:20
First time I had to use <:BanHammer:805396864639565834> on someone who is not a crypto-spammer or something like that.
2024-04-19 12:05:01
I feel a bit sad but it had to be done.
Fox Wizard
2024-04-19 12:18:26
Yeah, it's unfortunate since he doesn't have bad intentions. Just sad that he doesn't really learn from warnings
_wb_
2024-04-19 12:25:10
IIRC I gave him a one-week timeout five times, each time he just resumed when the timeout was over. I can live with some noisy communication and idiosyncratic behavior, and this is only an informal chat anyway, but the fact that he goes all over the place (in several channels) and tends to post stuff that takes quite a bit of vertical space made it really quite annoying and disruptive.
jonnyawsom3
2024-04-19 12:26:49
Not to mention when he posted to every github issue we had been associated with during the first timeout
spider-mario
2024-04-20 07:50:29
and the random mentions
Fox Wizard
2024-04-23 01:29:06
That sad moment when a very old jxl version creates a vastly superior result over a new jxl version <:KekDog:884736660376535040>
2024-04-23 01:35:21
2024-04-23 01:35:38
On the positive side, at least new cjxl was about 6 times faster with encoding XD
jonnyawsom3
2024-04-23 01:49:21
Oh, interesting. Discord put the JXL files into the 'gallery view' where you can just click left and right. Doesn't decode naturally, but now they're recognised
spider-mario
2024-04-24 09:18:28
still in love with the guitar here
2024-04-24 09:19:15
(I’ve tried to play those arpeggi; it’s… not easy)
Nova Aurora
2024-04-24 09:24:44
>We need to give the HTML5 spec to ISO so that the spec can be locked behind a paywall and we can start patenting the spec -Uni club
Nyao-chan
2024-04-25 06:48:11
I've been unconscious between 2024/04/15 and 2024/04/19, hospitalised without access to internet till 2024/04/24. I've just caught up with the @fab lore. He used to be different. A psychiatrist recommended me to take a test for Asperger's. I am. Will take around a year. (side note: I believe ICD-11 (2019/05/25) still hasn't been translated to Polish, even though it's in effect (2022/02/21), and I told him that I thought Asperger's is not used anymore and he told me that it is, but seems both dsm-5 and icd-11 just talk about autism spectrum? so is it??) During my hospital stay I've heard some wails and almost died myself. And now @fab is gone. I am feeling.
spider-mario
2024-04-25 06:53:49
correct, Asperger’s syndrome was merged with the rest of autism > Other enhancements have been introduced to promote ease of use across all settings: > […] > - Consolidation of autistic disorder, Asperger's disorder, and pervasive developmental disorder into autism spectrum disorder. > […] > Within the diagnosis of autism spectrum disorder, individual clinical characteristics are noted through the use of specifiers […], as well as specifiers that describe the autistic symptoms […]. These specifiers provide clinicians with an opportunity to individualize the diagnosis and communicate a richer clinical description of the affected individuals. For example, many individuals previously diagnosed with Asperger's disorder would now receive a diagnosis of autism spectrum disorder without language or intellectual impairment
2024-04-25 06:54:09
but some people in the autistic community are quite critical of the DSM anyway, and especially of its pathologising language
2024-04-25 06:54:29
for example, the author of “Neuroqueer Heresies” has said: > On top of that, most of these descriptions of autism – even many of the descriptions written by autistics – propagate inaccurate information and false stereotypes. Some are so bad that they actually quote the DSM.
Nyao-chan
2024-04-25 07:00:58
I see there's a lot to learn.
2024-04-25 07:01:07
/gen
spider-mario
2024-04-25 07:05:18
on the frequent desire to “subtype” autism, the authors of “Autistic Masking: Understanding Identity Management and the Role of Stigma” have noted that: > The labelling of autistic people as ‘heterogeneous’ is dehumanising. Whilst people assumed to be neurotypical are labelled as having ‘individual differences’ that impact on their similarity to each other (e.g. differences in attention or memory), autistic people are often assumed to be a monolith, despite early research highlighting the variation across the population (Wing & Gould, 1979). > > The emphasis on similarity, and minimisation of individual uniqueness implicitly suggests that whilst humans in general are complex and differ from each other in many ways, autistic people are expected to show more similarities. and: > Overall, both the diagnostic criteria for autism and the societal understanding of autism is limited, and our current understanding of what autism ‘looks like’ relies both upon stereotype and emerging knowledge about IM [Impression Management]. Researchers have attempted to address these issues by proposing the introduction of phenotypes/subtypes, keeping the core construct of autism intact. However, these divides are based on the assumption that the core construct is actually correct in the first place, and worth preserving.
_wb_
2024-04-25 08:35:41
Note that Hans Asperger collaborated with the Nazis or at least did some dubious things and seemed to hold beliefs supporting Aryan "race hygiene". I prefer not to honor such people by naming something after them.
w
2024-04-25 08:56:01
what about the rest of half of everything discovered and invented
Nyao-chan
2024-04-25 09:12:13
I don't think I will be able fix myself from hearing it as south park's "ass burgers" that and fish sticks
Fox Wizard
2024-04-25 09:24:25
~~Who doesn't like to put them in their mouth <:thinkies:854271204411572236>~~
spider-mario
Nyao-chan I don't think I will be able fix myself from hearing it as south park's "ass burgers" that and fish sticks
2024-04-25 10:37:54
it reminds me more of asparagus
2024-04-25 10:38:03
(all the more because asparagus in French is _asperge_)
2024-04-25 10:38:57
https://fr.wikipedia.org/wiki/Asperge
Nova Aurora
Nyao-chan I've been unconscious between 2024/04/15 and 2024/04/19, hospitalised without access to internet till 2024/04/24. I've just caught up with the @fab lore. He used to be different. A psychiatrist recommended me to take a test for Asperger's. I am. Will take around a year. (side note: I believe ICD-11 (2019/05/25) still hasn't been translated to Polish, even though it's in effect (2022/02/21), and I told him that I thought Asperger's is not used anymore and he told me that it is, but seems both dsm-5 and icd-11 just talk about autism spectrum? so is it??) During my hospital stay I've heard some wails and almost died myself. And now @fab is gone. I am feeling.
2024-04-26 02:05:28
<@703028154431832094> 's av1 for dummies server has a fab channel
Nyao-chan
2024-04-26 06:44:23
<@224363555074342912> thank you, but It's not that I miss the messages I could not understand, I just feel sorry for Fabian who through no fault of his own is going through something like this. I also reflected on how ephemeral and uncertaint life is. (Which I am absolutely willing to admit is a wholly unoriginal thought and just a part of growing up everyone goes through and this week it was my turn)
_wb_
spider-mario (all the more because asparagus in French is _asperge_)
2024-04-26 07:11:08
Yes, that too. Both in French and in Dutch we say "asperge". It's the season by the way, just the other day I cooked "asperges à la flamande" which is probably the most popular way to eat them here. It's very delicious. https://www.biendecheznous.be/recettes/asperges-la-flamande
2024-04-26 07:14:03
that with some steamed potatoes (I like small ones, in the skin)
Nyao-chan <@224363555074342912> thank you, but It's not that I miss the messages I could not understand, I just feel sorry for Fabian who through no fault of his own is going through something like this. I also reflected on how ephemeral and uncertaint life is. (Which I am absolutely willing to admit is a wholly unoriginal thought and just a part of growing up everyone goes through and this week it was my turn)
2024-04-26 07:21:30
It's hard to estimate what exactly @fab's situation was/is but yes, whatever it was, I also feel sorry for him. I don't think there's an awful lot we could do to help though, but I like to think that perhaps getting banned from this discord will somehow slightly help him to get the change he needs. In any case, I hope he has people in his more direct environment who can help him or find help.
DZgas Ж
DZgas Ж
2024-04-26 01:12:55
# uh oh. so far, the development of my software is very slow. but I'm doing it anyway. I wrote code to index downloaded groups from **telegram** in JSON format quickly and also wrote 2 implementations for searching images in the database. for online (1 photo) and for offline (as many photos as you want). so far, there are only optimizations for 1 photo(online), if a little, then it's better to look there. Optimizations for multiple searches have been disabled so far. I plan to write a discord parser on the downloaded server with images. because I have no idea where else to get hundreds of thousands of photos to search for them. google does not give its database of Google photos unfortunately *in all seriousness, I use this software only to see which pictures I have already posted* but nevertheless, hundreds of downloaded TG groups is usefulness (some have the author's nickname on Twitter)
2024-04-26 01:13:57
the only thing that gives me motivation is the complete absence of recognition collisions on a database of 1 million photos
2024-04-26 01:15:21
the database is not private. it just 80 md in 7z and I can only send a small part of it. but it doesn't seem to make much sense. you will definitely not find the photos that you have
2024-04-26 01:17:45
The search information, or as I call it IMAGE ID, size only 80 megabytes per 1.5 million images
Meow
2024-04-26 06:30:11
Had a significant earthquake here again
lonjil
2024-04-26 06:34:20
oof
spider-mario
2024-04-26 06:48:30
the idea of writing a blog post about the “sleeping beauty paradox” has occupied my mind for a few days, and I’ve finally started to actually write it
2024-04-26 06:48:36
it will obviously settle the question once and for all
2024-04-26 06:49:25
the arguments for 1/3 are fallacious in variously subtle ways
Meow
2024-04-26 07:00:20
So frequently that another just happened
yoochan
Meow Had a significant earthquake here again
2024-04-26 08:20:04
Where?
spider-mario the arguments for 1/3 are fallacious in variously subtle ways
2024-04-26 08:20:45
Nice! I had planned to go to bed, now I have a full wikipedia article to read before
spider-mario
2024-04-26 10:00:45
this problem is possibly the worst nerd snipe I have ever come across (for me)
2024-04-26 10:00:47
https://xkcd.com/356/
2024-04-26 10:01:56
(I am trying to come up with a setup in which 1/3 is the correct answer, and to pinpoint exactly what it is that makes it different)
2024-04-26 10:02:04
(I have the setup, I’m now doing the latter)
Meow
yoochan Where?
2024-04-27 05:29:27
In Taiwan. Not a famous place
DZgas Ж
2024-04-27 05:33:03
I spent half a day creating this track from 50 attempts to generate different samples. and then I sewed these samples and do mastering, and why no one appreciated (anywhere at all). You can listen to https://youtu.be/gZE4CfIjgg4
2024-04-27 05:34:10
No matter how hard I try, I can't figure out whether the neural network is not interesting for anyone, or music in general.
2024-04-27 05:35:52
although it is definitely difficult to say whether the soul appeared in the music from the fact that I combined it <:Thonk:805904896879493180>
Nyao-chan
spider-mario this problem is possibly the worst nerd snipe I have ever come across (for me)
2024-04-27 03:23:27
the more I think about it the more obvious it seems to be it can only be 1/2? even if it was 1 vs 1e6 wakings. I'm looking at Wikipedia and I don't have a precise definition of "degree of belief", but for one, it seems whatever comes up on the coin, the beauty is only being asked once?
spider-mario
2024-04-27 03:24:15
if the coin comes up tails, she is asked twice (once on Monday and another time on Tuesday but with zero memory of being asked on Monday and no way to distinguish the two)
2024-04-27 03:24:25
I argue that the number of times she is asked shouldn’t affect the answer
Nyao-chan
2024-04-27 03:24:56
ah wait, she is being asked multiple times. but those are not independent variables.
spider-mario
2024-04-27 03:25:21
in fact, the problem is exactly equivalent to asking her to write her answer on a piece of paper and reading it once or twice depending on the outcome
2024-04-27 03:25:26
no need to put her to sleep at all
Nyao-chan
2024-04-27 03:26:29
even 1 vs n times being asked, it's 1/2, and in half the coin outcomes she would be wrong
2024-04-27 03:27:52
Ambiguous question position edit Another approach to the Sleeping Beauty problem is to assert that the problem, as stated, is ambiguous. This view asserts that the thirder and halfer positions are both correct answers, but to different questions.[10][11][12] The key idea is that the question asked of Sleeping Beauty, "what is your credence that the coin came up heads", is ambiguous. The question must be disambiguated based on the particular event whose probability we wish to measure.
lonjil
2024-04-27 03:28:01
That argument that she knows beforehand that the probability is 50% and doesn't ever gain more information is quite compelling...
Nyao-chan
2024-04-27 03:28:02
Wikipedia copy paste
spider-mario
2024-04-27 03:28:28
as far as I can tell: it would be 1/3 if the question were “if, in a series of repetitions of this experiment, we pick one awakening at random, what will have been the outcome of the *last* coin flip before that point?”, not because the probability that we assign to any single specific flip is different from 1/2, but because _which_ flip we are talking about is a moving target, and the flip from two awakenings ago can be the last flip if and only if it (there was one and) it came up tails
Nyao-chan
2024-04-27 03:28:41
like if I'm betting money each time I'm being intervied, I'd not say 1/2
spider-mario
2024-04-27 03:31:08
indeed, but it’s arguably because the betting procedure itself is distorted
2024-04-27 03:31:51
“what will you bet? btw, if it’s tails, the bet will be executed twice”
Nyao-chan
2024-04-27 03:32:29
yeah. I like the ambiguous question answer the most. I was disappointed when the article on degree of belief was so lackluster
Traneptora
2024-04-29 03:33:54
as a mathematician I consider the solution to be fairly obvious
2024-04-29 03:34:03
if she knows how the experiment works, then she knows the probability is 1/2
2024-04-29 03:34:06
there's not much else to it
spider-mario
2024-04-29 08:11:38
the author of the problem does offer an argument for 1/3 (https://www.princeton.edu/~adame/papers/sleeping/sleeping.pdf), but the argument is flawed (as could be expected)
2024-04-29 08:13:08
at a meta level, P(the answer is 1/2 | that argument) = P(the answer is 1/2) × P(that argument | the answer is 1/2) / P(that argument)
2024-04-29 08:13:15
which is still high
2024-04-29 08:13:40
and therefore, the probability that the argument is wrong, also high
2024-04-29 08:14:44
the thing is that the exact way that it’s wrong can be a bit subtle; hence my attempt at exposing it for all to see
2024-04-29 08:28:03
I think I’m almost done, btw
2024-04-29 08:28:48
I’m proofreading and checking whether there are any obvious reinforcements to make
_wb_
2024-04-29 08:34:15
let us know if you want an external proofreading
yoochan
2024-04-29 08:40:20
😄
2024-04-29 08:41:16
is it math monday ?
spider-mario
2024-04-29 08:49:45
here we go: https://sami.boo/post/statistics/sleeping-beauty/
Crite Spranberry
2024-04-29 09:15:03
1: What the fuck does this mean
2024-04-29 09:15:50
2: Does this even happen? What is the point of such an experiment? Why are we thinking about a scenario that just won't happen?
spider-mario
2024-04-29 09:16:45
``` 2022-04-12 13:32:27 spider-mario oui mais ça arrivera pas donc à quoi bon y penser 2022-04-12 13:32:29 spider-mario problem solved ```
lonjil
2024-04-30 04:06:42
_wb_
2024-04-30 04:29:12
https://tenor.com/view/shocked-face-wide-eyes-bug-eyes-shocked-surprised-gif-17836791
spider-mario
2024-04-30 05:37:41
https://youtu.be/Rr_T4Aim6Fw
Traneptora
lonjil
2024-05-01 10:46:03
this is unironically the best abuse of notation I've ever seen
2024-05-01 10:46:30
rewriting it as `(1 - int) f` where `1 - int` is a differential operator legit works
2024-05-01 10:46:44
like it's a stupid meme but this unironically actually checks out
2024-05-01 10:47:10
though you have to make some magic
2024-05-01 10:47:31
basically `int` is a differential operator which is a linear transformation from `C^inf -> C^inf`
2024-05-01 10:47:47
and instead of "dividing by both sides" you're taking an inverse differential operator
2024-05-01 10:48:09
since the kernel is 1-dimentional, the "inverse" is actually a family of functions spanned by a single vector, and that's where C comes from
2024-05-01 10:48:42
as written, it's an abuse of notation
2024-05-01 10:48:47
but it can be made rigorous using Linear Algebra