JPEG XL

Info

rules 57
github 35276
reddit 647

JPEG XL

tools 4225
website 1655
adoption 20712
image-compression-forum 0

General chat

welcome 3810
introduce-yourself 291
color 1414
photography 3435
other-codecs 23765
on-topic 24923
off-topic 22701

Voice Channels

General 2147

Archived

bot-spam 4380

off-topic

Jim
w it was found that it's because of the presence of ad blocker
2023-11-21 11:32:59
They also say that JXL doesn't provide enough of a difference from other formats, is slower, and doesn't have much interest from the community.
2023-11-21 11:43:01
Regardless of if it's targeted or ad-related, they should not be putting that much influence on their ads over content. I remember a number of sites even back in 2019 would quickly load content if, for instance, their ad server went down, it would remove the ad and play the content. Now, most sites will just sit with an non-working ad. Some would continue running the countdown even if the ads stopped playing and went back to the content when the timer hit zero. Now it sits and does nothing - potentially indefinitely - when the ad fails. This is horrible user experience and goes completely against when their web development and the IAB have promoted over the years as focusing on experience and not putting ads in charge of it.
w
2023-11-22 01:24:14
yeah that's the point
2023-11-22 01:31:58
Requirements change and when they decide that the service requires making money then 🤷. People feel entitled just because it used to be "free." But really it never has been for normal users. It's already been a while since the current change and the same thing has already passed for twitch, which already has a more aggressive ad system.
yoochan
Jim Regardless of if it's targeted or ad-related, they should not be putting that much influence on their ads over content. I remember a number of sites even back in 2019 would quickly load content if, for instance, their ad server went down, it would remove the ad and play the content. Now, most sites will just sit with an non-working ad. Some would continue running the countdown even if the ads stopped playing and went back to the content when the timer hit zero. Now it sits and does nothing - potentially indefinitely - when the ad fails. This is horrible user experience and goes completely against when their web development and the IAB have promoted over the years as focusing on experience and not putting ads in charge of it.
2023-11-22 07:25:45
you guys still have ads before your videos ? ublock origin is your savior 😄
w
2023-11-22 07:35:12
i never got the ads
2023-11-22 07:35:25
but i got the popup and decided i'd rather not participate in the battle
Jim
w Requirements change and when they decide that the service requires making money then 🤷. People feel entitled just because it used to be "free." But really it never has been for normal users. It's already been a while since the current change and the same thing has already passed for twitch, which already has a more aggressive ad system.
2023-11-22 11:00:36
That's what drives people away from platforms (and sometimes to piracy). I already watch a fraction of YT I used to watch years back. Both because the content quality is declining and the ads are increasing. I remember just a few years ago they were promoting quality over quantity. Now they have the TikTok-like shorts and all that is out the window. It's a cycle that has nothing to do with entitlement and free-vs-paid. Even if I paid for ad-free YT I would be watching less and less of it. There's no entitlement. Public pressure is what pushes companies to stop doing anti-competitive and anti-consumer changes. It's public pressure that will get JXL added into browsers.
w
2023-11-22 11:01:00
or you just grew out of it
Jim
yoochan you guys still have ads before your videos ? ublock origin is your savior 😄
2023-11-22 11:01:02
I never though YT was going to get into the cat-and-mouse game. ublock will eventually be figured out as well.
2023-11-22 11:01:24
Or you're just making excuses, w
w
2023-11-22 11:04:32
well, you are also making excuses
2023-11-22 11:05:14
youtube is just a platform
2023-11-22 11:05:20
and they just happen to need to increase their tax
2023-11-22 11:05:58
hmm that's a good analogy
2023-11-22 11:06:05
you dont *need* to pay taxes
2023-11-22 11:06:42
you don't want to pay taxes or you're now a criminal? just go to another country
Jim
2023-11-22 11:09:52
That's likely what is going to happen in the long run - people will start using another service. Had they been a smaller service they likely would be losing a large % of viewers already. It's likely smallish at the moment but will likely continue to grow.
w
2023-11-22 11:10:15
so why doesn't everyone just move to new zealand
Jim
2023-11-22 11:10:19
But it doesn't mean people shouldn't try to push them in a better direction first.
w
2023-11-22 11:10:30
or uhh
2023-11-22 11:10:31
oregon
Jim
2023-11-22 11:11:37
A lot of people already move to Texas and Florida for that very reason. Not Oregon because... it's Oregon.
2023-11-22 11:12:43
New Zealand because it's difficult to get citizenship in other countries and New Zealand is fairly small and would get overrun pretty quickly.
spider-mario
2023-11-22 12:36:37
one French presidential candidate wants France to tax its expats, the same way that the US and Eritrea do it
lonjil
Jim A lot of people already move to Texas and Florida for that very reason. Not Oregon because... it's Oregon.
2023-11-22 01:16:40
but Texas has rather high taxes...
Jim
2023-11-22 01:18:39
But no income tax.
lonjil
2023-11-22 01:21:38
Yes. So if you're rich, you pay less overall tax in Texas than in say, California. But if you're a normal person, the state of Texas gets more of your money than California would.
Jim
2023-11-22 01:55:17
A lot of people from NY and CA are moving to TX. The biggest complaints I've seen are incompetent gov employees. So either people are not aware that they are paying more and/or are willing to pay a bit more for gov that is not constantly getting things wrong and harassing them about it. Both NY and CA are also in the news alot for some pretty bad gov actions and just trying to gloss over a lot of issues. Granted, as more people move to TX and with their massive infrastructure issues, it's likely a number of people will be fleeing from there as well over the coming decade.
lonjil
2023-11-25 02:39:04
<https://lwn.net/SubscriberLink/952034/9d9742e4a537ff5b/> Linus Torvalds: > What is really needed, he said, is to find ways to get away from the email patch model, which is not really working anymore. He feels that way now, even though he is "an old-school email person". I can't believe it
Traneptora
lonjil <https://lwn.net/SubscriberLink/952034/9d9742e4a537ff5b/> Linus Torvalds: > What is really needed, he said, is to find ways to get away from the email patch model, which is not really working anymore. He feels that way now, even though he is "an old-school email person". I can't believe it
2023-11-25 03:42:22
FFmpeg has been going on and off for years about this exact issue
2023-11-25 03:42:31
since it still uses conventional ML patches
2023-11-25 03:42:43
but nobody wants to move to gitlab because of "a metric fuckton of javascript" or the like
lonjil
2023-11-25 03:43:49
Some parts of the kernel have already moved to GitLab, funnily enough
2023-11-25 03:44:09
mostly display and GPU stuff
Quackdoc
2023-11-25 10:39:42
GitLab is absolutely terrible. It feels like they're changing UI at least once a year, and it's crap. Absolutely crap.
Traneptora
2023-11-26 03:21:51
sourcehut is another option
Quackdoc
2023-11-26 03:28:06
Im not the biggest fan of sourcehut myself, I find it... clunky?
Traneptora
2023-11-26 03:45:38
i like github personally
Quackdoc
2023-11-26 03:46:16
there is a lot I dont like about github, but the pros far outweigh the cons imo
damian101
Quackdoc GitLab is absolutely terrible. It feels like they're changing UI at least once a year, and it's crap. Absolutely crap.
2023-11-26 06:24:23
What are you talking about?
2023-11-26 06:24:26
It's great
2023-11-26 06:24:36
I like GitHub's aesthetics
2023-11-26 06:24:45
But GitLab has better functionality
2023-11-26 06:25:10
at least in the ways that were relevant for me in the past
Quackdoc
What are you talking about?
2023-11-26 06:29:59
* change UI yearly making it nice and new each time * PRs and Issues and releases are are behind submenus, needs project to pin them * code search not worth half a damn * some repos need you to log in to search * issue search itself uses stupid tag thing which makes minor corrections a pain * zero discovery tools * pipelines are a pain to read into * issue/PR notifications behind a hamburger menu * can no longer collapse right side bar on PR overview (but you can on issue tickets)
2023-11-26 06:30:07
and this is off the top of my head,
2023-11-26 06:31:08
im also not sure what functionaility gitlab has that github doesn't myself, nothing ive noticed, well aside from self hosting
damian101
Quackdoc im also not sure what functionaility gitlab has that github doesn't myself, nothing ive noticed, well aside from self hosting
2023-11-26 06:35:15
well, GitHub for example simply failed at importing an external project... don't remember the other reasons why I preferred GitLab, had something to do with the editor and stuff I think, but among other things... was long ago (didn't notice an UI change over two years though)
Quackdoc * change UI yearly making it nice and new each time * PRs and Issues and releases are are behind submenus, needs project to pin them * code search not worth half a damn * some repos need you to log in to search * issue search itself uses stupid tag thing which makes minor corrections a pain * zero discovery tools * pipelines are a pain to read into * issue/PR notifications behind a hamburger menu * can no longer collapse right side bar on PR overview (but you can on issue tickets)
2023-11-26 06:37:49
Merge Requests and Issues are pinned by default though
Quackdoc
2023-11-26 06:38:55
almost all projects i've seen have only started to do this like within a week or two now, so I don't think they were
2023-11-26 06:39:16
mesa, qemu and fdroid being three projects I very often frequent
damian101
Quackdoc almost all projects i've seen have only started to do this like within a week or two now, so I don't think they were
2023-11-26 06:44:24
yes, might not have been default behaviour for more than a a few months...
Quackdoc
2023-11-26 06:45:24
the main thing for me I wish gitlab had was discoverability, but in terms of large project management like something like ffmpeg, I dunno. beyond that gerrit is an option, kinda sucks for community contrib tho
Oleksii Matiash
2023-11-26 09:43:36
Guys, does anybody have an experience with xtensor lib?
lonjil
2023-11-26 02:09:33
TIL iOS contains a fairly up to date copy of Dear ImGui
diskorduser
2023-11-26 02:19:16
why do they have fsr
lonjil
2023-11-26 02:22:16
i have no idea
2023-11-26 02:23:04
I just saw "Copyright Advanced Micro Devices (FX Super Resolution)" in the open source licenses list.
Traneptora
2023-11-26 02:39:09
I would have had no idea with that poorly formatted issue had they opened
veluca
Traneptora I would have had no idea with that poorly formatted issue had they opened
2023-11-26 02:49:30
doesn't matter who that person is, what you said is still true 😛
2023-11-26 02:51:05
in particular, if it were up to me, I'd ignore anything reported by anybody saying that they compiled with -Ofast
Traneptora
2023-11-26 02:54:52
for the most part, yes. code that breaks rules like the strict aliasing rule can get mangled by optimizations because the compiler starts making assumptions about the code that may not be true
veluca
2023-11-26 02:55:49
-O3 should work fine.. back in the day it didn't actually help speed, but perhaps nowadays it does, who knows
Traneptora
2023-11-26 02:55:51
if the code is fully correct though, -O3 promises that it will not break it (bugs notwithstanding)
2023-11-26 02:56:00
but -Ofast makes no such promise
2023-11-26 02:56:53
the problem with -O3 is that it aggressively unrolls loops which means that it increases code size
2023-11-26 02:56:59
which can possibly have a negative impact on performance
veluca
2023-11-26 02:57:24
it can also be undesirable for other reasons, of course 😄
Traneptora
2023-11-26 02:57:29
another potential issue is that you gain a lot less from -O3's tree-vectorize when you already are using simd
2023-11-26 02:57:41
since autovectorization doesn't really help if you're manually vectorizing anyway
2023-11-26 02:58:01
because libjxl relies on highway to do a lot of the heavy lifting I don't think -O3 is actually necessary for it
veluca
2023-11-26 02:58:30
yup, although apparently the first post mentions a 9 to 14% speedup?
2023-11-26 02:58:38
perhaps that's more true in modular mode
Traneptora
2023-11-26 02:58:43
for pure C code that does numbercrunching I'd believe that
2023-11-26 02:59:01
but for code with simd or highway simd I'd imagine it's a lot less
2023-11-26 02:59:17
hydrium is noticeably faster with O3 vs O0 for example
veluca
2023-11-26 03:00:25
I think those numbers were on libjxl itself, at least the gcc bugzilla seems to say that
2023-11-26 03:00:50
(also, O0 is super slow :P)
Traneptora
2023-11-26 03:26:28
¯\_(ツ)_/¯
lonjil
2023-11-26 03:28:43
even -O0 can explode the universe if you've got UB in ya code
Fraetor
2023-11-26 08:54:26
At that point isn't your code just broken?
lonjil
2023-11-26 09:09:45
The same is true of code that explodes at -O3 (assuming O3 is not so buggy these days)
bonnibel
2023-11-26 09:22:52
rust uses O3 by default for release builds so its probably fine in llvm/clang at least
Cacodemon345
2023-11-27 05:23:41
PCSX2 dumps Wayland support in https://github.com/PCSX2/pcsx2/pull/10179 (merged), one of the reasons being the lack of an absolute-coordinate window positioning protocol.
Quackdoc
Cacodemon345 PCSX2 dumps Wayland support in https://github.com/PCSX2/pcsx2/pull/10179 (merged), one of the reasons being the lack of an absolute-coordinate window positioning protocol.
2023-11-27 05:26:55
not a surprise, sure, X is broken by design, but wayland is designed to be broken, i've given up on wayland, target xwayland and call it good
Cacodemon345
2023-11-28 01:58:20
Also see: the earlier debate in the forum on the PCSX2 thread.
Quackdoc
2023-11-28 02:25:08
im not dipping my toes in this one, I get enough notifs from the pcsx2 thread lmao
lonjil
2023-11-28 02:29:53
I don't think Wayland is ready to replace X for everyone yet, but the reality is that the Linux desktop has always been really deficient and Wayland just has a different set of deficiencies. And no one works on foundational X stuff for Linux anymore, Wayland will be the only functional choice.
2023-11-28 02:32:26
'course, there's always the option to run an entire X11 DE under XWayland.
Quackdoc
2023-11-28 02:35:04
wayland is terrible, x11 is terrible linux users in shambles
lonjil
2023-11-28 02:49:33
X11 is bad, but most of the terribleness is in Xorg
Quackdoc
2023-11-28 03:24:23
shoulda just re-wrote X in rust xD
Cacodemon345
2023-11-28 07:55:19
You know, someone in the comment section of that Brodie Robertson video talking about PCSX2 disabling Wayland by default said that someone he knew said that X11 would go down because it got designed by a committee (likely false), and Wayland's going down the exact same path (also not too sure about that).
2023-11-28 07:55:50
I wonder if the chance wlroots becoming the only game in town would also mean the chance of it becoming the new X11.
lonjil
2023-11-28 08:02:45
I don't see GNOME and KDE's Wayland implementations going away.
2023-11-28 08:03:00
And it'd be the new Xorg, not the new X11
2023-11-28 08:03:21
X11 has a few server implementations, but Xorg is the only non-nested one anyone uses on Linux.
Cacodemon345
2023-11-28 08:30:52
I mean being the new Xorg would mean return of the mess plaguing the current one.
Traneptora
2023-11-28 09:00:46
what even is Xwayland?
2023-11-28 09:01:00
Is it an X11 server and wayland compositor in one?
190n
2023-11-28 09:04:22
it's an X server and a wayland _client_
lonjil
2023-11-28 09:25:47
You can even run a full X session under Xwayland, e.g. a full KDE Plasma desktop or something.
190n
2023-11-28 09:26:00
that's in the "rootful" mode right?
lonjil
2023-11-28 09:26:03
yeah
2023-11-28 09:26:25
It's a pretty decent option if you need X11 but are on hardware that Xorg has poor support for (e.g. Apple laptops)
Traneptora
190n it's an X server and a wayland _client_
2023-11-28 10:38:19
so it's a server implementation of X11 that exists as a wayland application that other wayland applications sit next to?
190n
2023-11-28 10:38:30
yeah
lonjil
2023-11-28 10:43:13
look ma, I'm running an X application inside Xwayland inside a Wayland compositor running nested under Xorg
spider-mario
2023-11-28 11:26:16
does Wayland mean the end of being able to run graphical Linux apps on Windows?
2023-11-28 11:26:37
with X11, one could use an X11 server for Windows (such as https://sourceforge.net/projects/vcxsrv/) and point WSL apps to that
lonjil
2023-11-28 11:27:52
WSL has built in support for Wayland IIRC
2023-11-28 11:29:56
yeah https://github.com/microsoft/wslg
2023-11-28 11:30:07
Enabled automatically for new WSL2 installations
spider-mario
2023-11-28 11:32:49
ah, I’m still on WSL1
2023-11-28 11:33:08
last I checked, they still hadn’t fixed the interference between WSL2 and VirtualBox
2023-11-28 11:33:46
still, that’s good to know, thanks
Quackdoc
lonjil You can even run a full X session under Xwayland, e.g. a full KDE Plasma desktop or something.
2023-11-29 06:10:22
this is how termux works
spider-mario does Wayland mean the end of being able to run graphical Linux apps on Windows?
2023-11-29 06:10:37
nope, wayland actually made this marginally easier
spider-mario last I checked, they still hadn’t fixed the interference between WSL2 and VirtualBox
2023-11-29 06:12:26
virtualbox "fixed" this by disabling hardware acceleration, unlike every other VMM which can be accelerated using windows WHPX. I reccomend using vmware or qemu typically. Vmware workstation is a lot more preformance then vbox, but it is "payed software" (IE. they don't care when people share personal use licences)
username
2023-11-29 06:14:07
there is a free version of VMware and the only real useful feature I can think of that it's missing compared to it's paid counterpart is snapshots
2023-11-29 06:14:41
oh and also I think the free version is also limtied to only one VM running at the same time
Quackdoc
2023-11-29 06:15:51
networking stuff from workstation is significantly better also workstation has a marginally better graphics emulation
DZgas Ж
2023-11-29 01:55:21
challenge.
diskorduser
2023-11-29 02:18:10
What is this
DZgas Ж
diskorduser What is this
2023-11-29 02:19:40
solve it
diskorduser
2023-11-29 02:20:00
I don't even understand the question/challenge
DZgas Ж
2023-11-29 02:34:24
maybe <@794205442175402004>
_wb_
2023-11-29 02:38:11
uh no sorry, too cryptic for me
DZgas Ж
2023-11-29 02:40:32
😪
diskorduser I don't even understand the question/challenge
2023-11-29 02:43:31
Well, I describe the task that, it's ready-encoded data. The binary data type is converted to decimal digits, so that less space is occupied. 8x8 indicates the size of the image. The picture with arrows indicates the rules of movement in the image. The Huffman tree contains drawn blocks that need to be written to the image using binary data that needs to be translated from decimal
2023-11-29 02:44:11
although of course it was possible to think a little
_wb_ uh no sorry, too cryptic for me
2023-11-29 02:44:39
👉🌳
diskorduser
2023-11-29 02:44:53
Too difficult for my brain. Fab will solve it.
DZgas Ж
DZgas Ж challenge.
2023-11-29 02:45:34
<@416586441058025472> go fun https://discord.com/channels/794206087879852103/806898911091753051/1179420337880965180
fab
2023-11-29 02:47:20
88.116 e7 epf 2 p gaborish 0
DZgas Ж
DZgas Ж challenge.
2023-11-29 02:59:52
I have already dropped this task in a telegram to a group of 1,500 people, and no one understood a damn thing... in short, I just came up with a block algorithm for compressing very small 1-bit images (max 128 bytes.) it seems to me that no one has done this yet. perhaps when I write an encoding implementation at least in python (I hope i will do this in December) and equate it with current formats like png gif webp jxl
_wb_
2023-11-29 03:02:23
2023-11-29 03:02:59
assuming the decimal numbers represent 8 bits each
2023-11-29 03:07:10
processing-wise it's probably going to be annoying if you have variable shapes per symbol — it might be easier to use fixed 2x2 blocks or something, but then it basically becomes a 4-bit image at 1:2 resolution
DZgas Ж
_wb_ assuming the decimal numbers represent 8 bits each
2023-11-29 03:36:49
here is a translated text that I wrote to my friend regarding what I want to do: Wowa DZɢαs: I need an input matrix of values ranging from 1 to 256 in two planes (1 bit image) Make a complete search of all the options for the location of the paralepipeds with coordinates from 1 to 5 (That is, 16 options) While doing the counting for the same - the total occupied space. Creating a binary huffmon tree based on the frequency of occurrence By a complete search to find the variant that after the transformation (from the structural arrangement of the paralepipeds, creating a tree and immediately encoding into it) would take up the least bit As a result, getting information about which paralepipeds were used, their number, the size of the tree, the number of links in the graph, and the encoded data — this would all make up the total amount of information for choosing the best option Aleksander: it will be a long time, it seems to me Wowa DZɢαs: It depends on the size of the image, but in general, you can use this tactic: fill in the image once, then remove the most unpopular paralepiped, for example, somewhere a single block of 5 by 5, and make the next filling
_wb_
2023-11-29 03:39:15
exactly what I did on a piece of paper. and by the way, yes, I didn't notice initially, but it was possible to compress not into 5 bits but into 4 bits, using a 2 by 3 block, it was possible to remove an entire tree branch
2023-11-29 03:41:30
_wb_
2023-11-29 03:42:17
for images this small, signalling the huffman tree itself (including the interpretation of each code) is probably more expensive than the image data
DZgas Ж
_wb_ for images this small, signalling the huffman tree itself (including the interpretation of each code) is probably more expensive than the image data
2023-11-29 03:47:37
that's it. What I'm thinking about. if use blocks of a maximum of 5 by 5, then can use 4 bits to transmit each, instead of building a tree, can transmit the blocks themselves in the order of the tree. The size of the image I'm still thinking. either 256 or 64 pixels maximum, but this is at least 2 bytes at the beginning, because need to transfer the number of blocks
2023-11-29 03:48:11
I think I'll figure something out. 🥴👌
_wb_
2023-11-29 03:49:16
have you checked out the JBIG2 encoding schemes? If you're limiting yourself to 1-bit images, there are some nice tricks that can be used...
DZgas Ж
_wb_ have you checked out the JBIG2 encoding schemes? If you're limiting yourself to 1-bit images, there are some nice tricks that can be used...
2023-11-29 03:52:04
all I know is that all of them are relatively outdated, and that all, without exception, were created for much larger images than 8x8 (I remember how I tried to compile it here, and then I was very disappointed in the result)
2023-11-29 03:53:29
https://discord.com/channels/794206087879852103/794206087879852106/1082432983832731678
2023-11-29 03:55:22
I used a good image then.
2023-11-29 03:55:52
optipng -- 286 bytes jxl -e 10 -- 206 bytes 1 bit bmp paq8px -- 158 bytes jbig2 -- 279 bytes
afed
2023-11-29 03:59:03
png - 209 bytes
DZgas Ж
afed png - 209 bytes
2023-11-29 04:00:57
👌
MSLP
2023-11-29 05:29:31
jxl -e 10, converted from <@1034873369314730065> png - 196 bytes
DZgas Ж
2023-11-29 05:33:04
New <:JXL:805850130203934781> <:Stonks:806137886726553651>
MSLP
2023-11-29 05:41:25
damn, losless webp is very good on this one - 190 bytes file, the encoder reports: `Header size: 45 bytes, image data size: 119`
Quackdoc
2023-11-30 04:38:01
It still has windows on it too. The testing was done from an arch live CD image.
bonnibel
2023-11-30 04:19:47
got access to the manga109 dataset and yum, crunchy jpeg artifacts
2023-11-30 04:22:59
when you're good enough to make sure your screentone scans arent full of moire but cant be bothered to set the quality slider higher than 5
username
bonnibel got access to the manga109 dataset and yum, crunchy jpeg artifacts
2023-11-30 04:31:22
https://github.com/victorvde/jpeg2png https://github.com/ilyakurdyukov/jpeg-quantsmooth
bonnibel
2023-11-30 04:31:52
how do these compare to djpegli?
2023-11-30 04:43:46
gimp native, djpegli, jpeg2png (500 iter), jpegqs
2023-11-30 04:46:47
looking at the whole image (wont post bc copyright), jpegqs reduces less artifacts than jpeg2png and leaves the lines a lot harsher / more bitonal. djpegli reduces artifacts a little but seems to thin the lines a lot, maybe its getting interpreted as the wrong transfer curve somewhere? 1s
2023-11-30 04:48:17
ah yeah that was it. pfm output
2023-11-30 04:48:41
jpegli. no artifact reduction
2023-11-30 04:56:18
looks like what jpeg2png does when trying to find an output that encodes to the same dct as the input, is optimize for a weighted combination of total generalized variation and mse
2023-11-30 04:56:36
according to the dev its specifically for non photographic jpegs which is what im dealing with here
2023-11-30 04:56:44
sadly no float output :(
2023-11-30 05:14:14
thanks, looks like ill go with jpeg2png for now
2023-11-30 05:14:41
is something like this likely to be added to djpegli at some point?
afed
2023-11-30 05:27:59
i don't think it's needed for decoder, more accurate rounding and light smoothing is ok (like in djpegli), but strong filtering is dangerous, it's not always needed and not good for all images and can smooth also important details, so such separate tools are better to use for that
spider-mario
bonnibel is something like this likely to be added to djpegli at some point?
2023-11-30 07:30:18
there’s a previous project that did something somewhat along those lines: https://github.com/google/knusperli
2023-11-30 07:31:22
but AFAIK, it doesn’t go as far as jpeg2png and jpegqs seem to
bonnibel
2023-11-30 07:54:36
yeah
2023-11-30 11:08:57
reading That One Upscaling article and. Caught this detail here
2023-11-30 11:11:20
the dataset doesn't have just 109 manga covers, it has 109 manga volumes unless, of course, you're using the only easily findable torrent of the dataset which contains low quality pngified versions of just the covers
afed
2023-11-30 11:20:30
perhaps meaning that only manga covers are used from this dataset
bonnibel
2023-11-30 11:27:44
"[t]he entire manga109 dataset will be used"
2023-11-30 11:28:04
i think he just grabbed the torrent and thought that was the whole dataset
afed
2023-11-30 11:43:43
then maybe, although I don't think non-color images would be needed at all for such comparisons
bonnibel
2023-12-01 12:05:46
when comparing traditional upsampling its pretty common to work on the greyscale version of a image afaik, since you're applying the same operation to all channels
2023-12-01 12:15:48
seen many papers with a line basically saying "yeah this'll probably generalize to multi-channel images fine, we didn't check"
afed
2023-12-01 12:15:52
yeah, but manga is mostly b&w line art and textured backgrounds
bonnibel
2023-12-01 12:16:02
yup
2023-12-01 12:16:37
for more real-life stuff i'm currently using RealSRv3
2023-12-01 12:16:56
its the real world super resolution dataset with the least alignment issues ive found
Traneptora
bonnibel the dataset doesn't have just 109 manga covers, it has 109 manga volumes unless, of course, you're using the only easily findable torrent of the dataset which contains low quality pngified versions of just the covers
2023-12-01 06:35:29
idk I read that as "this datasaet includes these manga covers" without a statement that it is limited to those
jonnyawsom3
2023-12-03 03:40:47
Not sure how many others noticed, but it seems Youtube keeps changing scaling methods depending on your scroll position, being blurry when still
w
2023-12-03 04:23:19
that's a chrome thing
2023-12-03 04:24:03
might be to do with compositing and gpu overlay
sklwmp
2023-12-05 05:36:39
https://blog.beeper.com/p/introducing-beeper-mini-get-blue
2023-12-05 05:36:58
Real client-side, end-to-end encrypted iMessage for Android 🥳
2023-12-05 05:37:10
hopefully this doesn't turn out to be a privacy nightmare like Sunbird/Nothing Chats
2023-12-05 05:37:17
it really does sound too good to be true
Nova Aurora
2023-12-06 08:33:37
It might be short lived with Apple RCS in 2024
Traneptora
2023-12-06 12:44:19
who cares about blue bubbles
sklwmp
2023-12-06 12:44:49
the US, apparently
2023-12-06 12:45:02
here we just settle for the privacy nightmare that is Facebook Messenger
Traneptora
2023-12-06 12:56:46
No, I mean
2023-12-06 12:56:59
why doew it matter if your bubbles are blue
lonjil
2023-12-06 12:57:52
Bubble color is a proxy for iMessage features
2023-12-06 12:58:34
And a proxy for whether you can afford an iPhone, if you hang out what those kinds of people :)
Traneptora
2023-12-06 12:59:56
but like, nobody cares if they text u and it's green
2023-12-06 01:00:18
Ive never seen someone scoff at that
jonnyawsom3
2023-12-06 01:01:48
I've honestly never heard of the bubble color or seen it up until all the fuss about it being blue for android now
sklwmp
Traneptora but like, nobody cares if they text u and it's green
2023-12-07 03:52:15
it apparently breaks group chats (reverts to mass SMS text), is less secure (no E2EE), less features (read receipts, typing indicators, reactions) and there's apparently some social stigma associated with that can't comment on the last one though since i personally haven't experienced anything like that
Traneptora
2023-12-07 03:52:33
>some social stigma
2023-12-07 03:52:49
nobody actually cares
diskorduser
2023-12-08 07:31:05
anyone has nightly libjxl build links? I need jpegli for windows.
2023-12-08 11:08:16
Thanks
2023-12-10 05:47:43
https://www.ddinstagram.com/reel/C0Mhy9SRTcC/?igshid=ODhhZWM5NmIwOQ==
spider-mario
2023-12-10 10:06:04
https://youtu.be/fg4t_XxJ8Bw entrancing
bonnibel
2023-12-10 12:39:01
lonjil
2023-12-10 01:39:11
a phone charger has more power than the apollo guidance computer
2023-12-11 12:08:48
<@1028567873007927297> `f{read,write,open}` are what is in standard C. They give you FILE pointers, and the standard says that reading and writing FILE pointers that have text streams does stuff like newline conversion.
2023-12-11 12:10:51
Windows has HANDLEs, which are similar to File Descriptors, but of course, those are only used in Windows APIs, not in standard C ones.
2023-12-11 12:11:22
(just like how FDs are not used for standard C functions, only POSIX functions)
username
2023-12-11 12:13:44
near context for the above messages: https://discord.com/channels/794206087879852103/804324493420920833/1183741909773062164
Cacodemon345
2023-12-11 02:27:01
https://www.phoronix.com/news/Linux-6.6.6-Released
DZgas Ж
2023-12-11 03:25:38
<:monkaMega:809252622900789269>
bonnibel
2023-12-11 04:22:24
the seal is broken..... it begins.... the year of linux on desktop....
2023-12-11 10:03:52
turns out putting 20k image pairs through butteraugli takes. a while
sklwmp
2023-12-13 01:40:42
TIL: `yt-dlp` can download "1080p Premium" videos, even without YouTube Premium. This has probably been here for a while; I've just never had to download YouTube videos in a while.
lonjil
2023-12-13 01:43:03
that's a much higher bitrate wow
sklwmp
2023-12-13 01:43:58
well, it's just an estimate, the actual file size was only around 300 MB
2023-12-13 01:44:18
do wonder why it's literally twice the actual filesize tho
190n
2023-12-13 05:36:16
it's probably estimated from only the first chunk or something
gb82
sklwmp https://blog.beeper.com/p/introducing-beeper-mini-get-blue
2023-12-13 11:15:47
patched by Apple
diskorduser
gb82 patched by Apple
2023-12-14 02:51:29
it is back again
gb82
2023-12-14 03:10:42
This sounds like a horrible game of cat & mouse that I would not want to pay to play
diskorduser
2023-12-14 03:21:48
yeah. In my country no one uses apple messages so I don't care. I installed beeper to see what it looks like.
DZgas Ж
2023-12-15 05:49:20
A funny observation. I started making an archive, which was 5 gigabytes, on a fat32 flash drive. after 10 minutes, 7 zip returned an error....... but WinRar, after reaching the size limit, just started making second part.rar Small thing.
username
2023-12-15 08:32:04
yeah, WinRAR tends to handle most situations wayy better then 7-Zip
yoochan
2023-12-15 08:47:32
*than 😄
sklwmp
2023-12-16 02:36:05
Seems like Thorium is under fire currently... https://www.reddit.com/r/browsers/comments/18ihls8/dont_use_thorium_browser_if_you_have_it_installed/
damian101
2023-12-16 03:28:15
🙄
diskorduser
2023-12-16 04:58:40
It is just a photo of circumcision and people call it porn. 😒
Quackdoc
2023-12-16 04:59:51
thats a remarkably stupid point lmao
HCrikki
2023-12-16 05:05:33
age is irrelevant nowadays, even a barely tech-savy toddler can handle build scripts and copypastas
w
2023-12-16 05:31:49
the issue isnt the inclusion of that stuff, it's the owner's attitude bleeding into the project.
yurume
2023-12-16 07:53:49
was that inclusion well-known to the project's users? otherwise it would be indeed problematic.
2023-12-16 07:55:17
for example, many FOSS projects (and others) do advertise many things besides from political stuffs, and while many don't care others do care about them, either positively or negatively
2023-12-16 07:56:47
but those advertisements are almost always in public, because otherwise why would you advertise them
2023-12-16 07:57:50
in comparison a sneaky inclusion is all about the trust, especially for binary releases where users have virtually no way to verify them
Traneptora
2023-12-16 09:04:26
regardless of your stance on these political issues, binary browser releases really are not the place for this
2023-12-16 09:05:20
it's not an issue of whether you think it's "actually porn" or not, that "yiff" image should never have been shipped out
Quackdoc
2023-12-16 09:12:55
I wouldn't care if they did it, if it was an actual easter egg thing, not accsessible from a standard page
Traneptora
2023-12-16 09:17:10
then it shouldn't be in binary releases
2023-12-16 09:17:20
if it's not accessible it's just bad form
2023-12-16 09:17:25
if it is accessible it's worse form
sklwmp
Traneptora if it is accessible it's worse form
2023-12-16 10:21:33
it is accessible, i'm pretty sure this was mentioned in this server before
2023-12-16 10:22:17
Traneptora
sklwmp it is accessible, i'm pretty sure this was mentioned in this server before
2023-12-16 10:24:21
I know it's accessible, I'm pointing out that making it inaccessible is still bad form
sklwmp
2023-12-16 10:24:39
ah, okay
w
2023-12-16 11:38:14
yeah it's bloat
damian101
yurume was that inclusion well-known to the project's users? otherwise it would be indeed problematic.
2023-12-18 02:38:47
It was basically a backup of http://sexuallymutilatedchild.org/ (not available in its old state anymore), including all assets, inside a Thorium-related repository.
2023-12-18 02:38:54
Actually, still there.
2023-12-18 02:39:32
The "yiff" furry porn pic was actually distributed with the browser.
2023-12-18 02:39:58
terribly bloated PNG
2023-12-18 02:40:08
should have used JXL
spider-mario
2023-12-18 08:45:51
2023-12-18 08:45:53
ugh
2023-12-18 08:47:00
… I stand corrected, it seems you really are supposed to answer logically to the question
2023-12-18 08:47:05
“Yes” leads to ^
2023-12-18 08:47:18
where indeed both options are available
2023-12-18 08:47:31
could have just shown that window to begin with
lonjil
2023-12-18 01:11:13
https://zamundaaa.github.io/wayland/2023/12/18/update-on-hdr-and-colormanagement-in-plasma.html
2023-12-18 01:12:30
color management and HDR coming to Plamsa soon
2023-12-18 01:16:02
> With that, Steam starts in a nested gamescope instance and games started in it have HDR working, as long as they use Proton 8 or newer. When this was initially implemented as a bunch of hacks at XDC this year there were issues with a few games, but right now, almost all the HDR capable games in my own Steam library work fine and look good in HDR. dang, soon not just the Steam Deck OLED, but any Linux desktop will be able to totally leapfrog Windows in terms of HDR support
Quackdoc
2023-12-18 01:19:23
Ive had two users tell me that MPV will trigger it too
2023-12-18 01:19:36
which is massive since before that you need to use amdvlk to get HDR on linux
yoochan
spider-mario
2023-12-18 01:26:43
nice you have the choice between yes and no, if I had to implement this dialog I would only put the [ Yes ] button
spider-mario
2023-12-22 09:25:46
https://youtu.be/sm-h0kVtGxE?t=1m29s
2023-12-22 09:25:48
a master at work
2023-12-22 09:26:48
(later: https://youtu.be/1vqHA5DbXBQ?t=5m30s )
DZgas Ж
2023-12-23 02:57:47
anecdote
2023-12-24 02:54:14
Sony patent https://patents.google.com/patent/US8246454?oq=8246454
Quackdoc
2023-12-24 02:55:41
https://tenor.com/view/wheeze-wheeze-laugh-nikkal-kundhal-nikkalkundhal-gif-23223780
spider-mario
2023-12-25 07:08:44
**J**oyeu**X** noë**L**!
2023-12-25 07:09:07
(why couldn’t I have thought of this 12-24h ago)
_wb_
2023-12-25 09:38:14
Jolly XLmas!
lonjil
2023-12-26 10:45:32
when will a rapper name themself after JXL? It took like 25 years for JPEG to achieve that feat.
spider-mario
2023-12-26 11:02:11
I expect that JPEG 2000 probably never will
2023-12-26 11:02:22
it’s such a ’90s name
2023-12-26 11:02:54
1990s, that is
2023-12-26 11:02:59
(won’t fare better in the 2090s)
yurume
lonjil when will a rapper name themself after JXL? It took like 25 years for JPEG to achieve that feat.
2023-12-27 02:04:03
not counting https://en.wikipedia.org/wiki/Tom_Holkenborg right?
lonjil
2023-12-30 12:29:35
metal subgenres, where you find very normal names like "progressive deathgrind"
paperboyo
2023-12-31 05:43:57
For Windows, this is good Custom Resolution Utility (CRU). If overkill, system Display Preferences will show a toggle next to HDR if supported (and a message if not).
2023-12-31 05:45:11
Happy, lean and artifact-free new year to all! https://www.theguardian.com/artanddesign/gallery/2023/dec/30/acrobatic-cats-inspired-by-salvador-dali-in-pictures
jonnyawsom3
2024-01-01 12:11:04
Happy new year
diskorduser
2024-01-01 02:49:20
2024-01-03 04:06:07
Right -> Jpegxl viewer app. It is very dark.
oupson
diskorduser Right -> Jpegxl viewer app. It is very dark.
2024-01-03 10:31:16
Is it https://github.com/oupson/jxlviewer on the right ?
2024-01-03 10:31:45
If it is the case, make sure that you are using the latest release (0.4.0).
diskorduser
oupson If it is the case, make sure that you are using the latest release (0.4.0).
2024-01-03 11:23:19
Thanks. I updated it and now it works well.
oupson
2024-01-04 06:06:11
For izzyondroid the process is automatic, it will get the new version in the next few days
DZgas Ж
DZgas Ж https://cdn.discordapp.com/attachments/677266163994198020/1075905185420939374/DZgas_music_tracklist_he_aac.mp4
2024-01-05 04:46:02
spider-mario
2024-01-06 05:34:25
https://youtu.be/2GRnrFfURYo
Traneptora
diskorduser Right -> Jpegxl viewer app. It is very dark.
2024-01-06 08:57:35
looks like a peak detection issue
yurume
2024-01-08 04:56:50
https://vxtwitter.com/senokay/status/1744220752805765452
DZgas Ж
2024-01-09 04:58:18
uuh
diskorduser
2024-01-11 01:31:25
https://flic.kr/p/8Wrghy
diskorduser https://flic.kr/p/8Wrghy
2024-01-11 01:32:09
<@416586441058025472> benchmark jxl with this
fab
2024-01-11 07:55:50
Alert loud audio
2024-01-11 05:26:15
I reached 800000hz
2024-01-11 05:29:16
Now I reached 1800000hz
DZgas Ж
2024-01-13 03:05:18
https://tenor.com/view/discord-discord-devs-discord-developers-discord-api-discord-employees-gif-25780576
.vulcansphere
2024-01-13 03:09:09
Media unable to load INCIDENT REPORT FOR DISCORD Investigating We are currently investigating an issue that is preventing embedded media from loading. Posted 17 minutes ago. Jan 13, 2024 - 06:18 PST This incident affects: Media Proxy.
spider-mario
2024-01-13 09:43:06
2024-01-13 09:43:10
🤔
jonnyawsom3
2024-01-14 05:38:11
Always gotta love when 'compress' options end up bigger than the original
diskorduser
2024-01-14 09:55:33
Probably they used av1/avif lossless.
Nova Aurora
2024-01-14 07:18:28
yoochan
2024-01-14 08:22:28
😆
lonjil
2024-01-14 09:07:22
wowza SVE has a lot of fancy instructions
2024-01-14 09:11:29
AVX has like, 4 instructions total that the docs state do math on complex numbers
2024-01-14 09:12:00
meanwhile SVE:
2024-01-14 09:48:10
even MVE (Helium), the vector extensions for ARM microcontrollers, have a bunch of complex number instructions, lol.
Traneptora
2024-01-15 05:40:48
guess I should switch hydrium to float
2024-01-15 05:42:36
only downside is that storing a full Group in RAM costs 256x256x6 bytes which is about 400k
2024-01-15 05:42:50
and changing that from 16-bit ints to 32-bit floats changes it to about 800k
2024-01-15 05:43:02
which is a lot more when the library only uses in the order of 1500k total
_wb_
2024-01-15 08:09:23
It would be nice if CPUs and GPUs supported something like an 3x 21-bit float type natively, i.e. fitting a full pixel in one 64-bit register and with a little more precision than 16-bit int or half-float. Say 1 sign bit, 5 exp bits and 15 mantissa bits, so it can represent int16, uint16 and float16 exactly but it has that little wiggle room of extra precision that could be useful for intermediate results. Plus one bonus bit per pixel that can be used for something.
lonjil
Traneptora guess I should switch hydrium to float
2024-01-15 08:12:10
Why?
spider-mario
2024-01-15 08:30:19
gotta go fast
veluca
_wb_ It would be nice if CPUs and GPUs supported something like an 3x 21-bit float type natively, i.e. fitting a full pixel in one 64-bit register and with a little more precision than 16-bit int or half-float. Say 1 sign bit, 5 exp bits and 15 mantissa bits, so it can represent int16, uint16 and float16 exactly but it has that little wiggle room of extra precision that could be useful for intermediate results. Plus one bonus bit per pixel that can be used for something.
2024-01-15 08:36:59
👀
_wb_
2024-01-15 08:40:08
it's of course rather specific to "stuff that works with vectors of 3 numbers", for which I know no other examples than images/video, so you could say it doesn't really belong in a general-purpose instruction set
2024-01-15 08:45:34
still, if there's a wishlist somewhere of "new instructions that would be cool", something like this might be a good candidate. When 16-bit is just a little too tight but 32-bit is a bit wasteful, having something in between is nice — and not having to deal with alignment of multiple-of-3 stuff is also nice.
2024-01-15 08:48:47
maybe 3x int21 instead of 3x float21 would also be useful
lonjil
2024-01-15 08:49:52
I think libopus has both floating point and fixed point, so you can Go Fast on typical hardware without suffering soft FP on embedded stuff.
Traneptora
lonjil Why?
2024-01-15 09:51:57
it should be faster if I'm not using hand-written assembly, simd, or intrinsics
lonjil
2024-01-15 09:52:43
ah
Traneptora
2024-01-15 09:53:02
since I'm not using manual instructions, a lot of my arithmetic is actually 32-bit
2024-01-15 09:53:17
which means 32-bit float is likely faster
lonjil
2024-01-15 09:53:35
ic
Traneptora
2024-01-15 09:53:40
400k is probably worth the memory overhead though
2024-01-15 09:53:49
I store an entire Group in RAM
2024-01-15 09:54:06
which is ~800k as 32-bit and ~400k as 16-bit
lonjil
2024-01-15 09:54:29
Maybe I should write a PR contributing some super not portable fixed point SIMD stuff.
2024-01-15 09:54:52
(actually, I wonder how hard it would be to find appropriate portable code patterns that reliably get autovectorized.)
Traneptora
2024-01-15 09:55:23
I won't accept it
2024-01-15 09:55:39
I'm intentionally not including that stuff not because I don't know how to write it (which I don't) but because I don't want it in there
2024-01-15 09:55:55
source-level portability is an important design goal
2024-01-15 09:56:30
basically I want it to do things that libjxl doesn't, which is be very portable and have a low-memory-footprint
2024-01-15 09:56:56
things that libjxl does well, such as coding efficiency and use of simd, my goal is not to try to beat it at those
lonjil
2024-01-15 09:58:26
mm
2024-01-15 11:36:41
https://www.macrumors.com/2024/01/15/app-store-to-be-split-in-two/
yurume
2024-01-16 06:30:08
maybe Kakao etc. are actually threatening both but one is abiding while one is ignoring and the legal action is too slow to observe
2024-01-16 06:31:43
if it's the case, it is really sad IMO, maybe the publisher should let abiding ones to survive but require ads for affected comic sources (which would then benefit publishers)
w
2024-01-16 06:32:16
https://fxtwitter.com/kakaoent_pcok/status/1744242383376781461
2024-01-16 06:32:33
they did the funny
yurume
2024-01-16 06:32:48
wtf
2024-01-16 06:33:22
I mean, it is clear that such apps do violate the copyright
2024-01-16 06:33:38
that doesn't still make such allegation true
w
2024-01-16 06:34:02
should just block SK
yurume
2024-01-16 06:34:28
the correct statement would be that advertising on their app directly benefits creators while those free apps don't and can't
2024-01-16 06:35:13
which is technically and ethically correct and can even pave a way to coexist without such issues
2024-01-16 06:35:26
(as I've said above...)
2024-01-16 06:36:58
technically speaking it can contain malware if you can't build one yourself though :p
2024-01-16 06:37:08
but otherwise it's a false claim...
2024-01-16 06:38:07
I'm more amused by its strange use of hashtags: `#PCOK #Protecting #the #Content #of #Kakao...`
2024-01-16 06:38:15
`#the`
2024-01-16 06:39:58
anyway, I'm aware of reasons that publishers say such things and I generally *want* to support them... but their apps are crappy at best
2024-01-16 06:40:17
not even mentioning the DRM
2024-01-16 06:42:15
so is it a self-closing emphasis tag? XD
2024-01-16 06:47:07
I have too many ebooks in my ridibooks account, which is one of the largest SK ebook services and in my opinion better than all other SK alternatives, but its desktop app is still crappy
2024-01-16 06:47:45
I once analyzed their app and found that it was doing all gymnastics to render a single page of JPEG in whooping 2 seconds...
2024-01-16 06:48:24
seriously, JPEG rendering at that size should never take more than 100ms
2024-01-16 06:48:49
it's not even like the file has a dimension of 3000 by 4000 pixels (so to say), I think it was about ~1200 px vertically
2024-01-16 06:49:19
yeah it's good to have APIs for such cases
2024-01-16 06:50:24
I can't see any way for ebook service or book publisher to release some sort of API without risking a copyright violation though
2024-01-16 06:50:37
(which always happens, by the way, but in much easier ways I meant)
yurume it's not even like the file has a dimension of 3000 by 4000 pixels (so to say), I think it was about ~1200 px vertically
2024-01-16 06:52:17
more amusingly, the content decryption was not even the biggest factor (thought it was significant, thanks to the fact that everything was written in JS!)
2024-01-16 06:52:43
for some reason it was keeping its own canvas to render decoded images, wtf?
2024-01-16 06:53:42
my guess is that it's an Electron app, as everything today is, and it didn't want any decoded image to stay in the world-readable cache
2024-01-16 06:54:14
but I refuse to believe that this was the optimal solution even if that was the intent
2024-01-16 06:55:33
(I believe the incognito/private mode can be enabled in such webviews which encrypts any disk cache with an in-memory-only key)
2024-01-16 06:56:53
and all this attempt was futile because it never blocked the remote desktop service
2024-01-16 06:57:41
it does use a built-in windows mechanism to hide itself from screenshots, but that's all
2024-01-16 06:58:24
at least it didn't come with a much stupider kernel-level "security" solution, it's why I keep using that service
2024-01-16 07:00:17
not really I think
2024-01-16 07:01:59
there are security solutions that do try to do more, often used in games or financial apps, but I'm not sure if it really helps
2024-01-16 07:02:56
I've seen dedicated attackers were always able to get around them anyway, so the question is probably the relative effectiveness for simple-minded attackers
2024-01-16 07:03:47
and I have no evidence that it generally works, but I don't have any counterevidence as well
2024-01-16 07:04:36
(cause I can do a substantial amount of reverse engineering, I don't know much about how "typical" attackers would behave)
diskorduser
2024-01-16 01:01:37
https://youtu.be/W4PHhurAhwc?si=7aU28TyzJ4VdWloB
2024-01-18 09:43:24
That file manager looks cool. I'm going to try it.
gb82
2024-01-18 07:48:17
I've since blocked him from all of my repos, since I got twenty six emails a couple of days ago as he was repeatedly commenting on random commits and issues. I recommend others do the same. He also DM'd me asking me not to take anything down for some reason
DZgas Ж
2024-01-20 09:12:17
I wrote my own script to create recovery data in case of accidental byte corruption. I decided to do this because when I moved the 451 GB gl folder from disk to disk, I broke 3 bytes, which I was able to restore, 10 hours before creating an ICE ECC file. The recxorf recovery files contain 1 byte of recovery per 64 kilobytes of data. There is no hierarchy of files, so the recovery information is recorded in their alphabetical order. This means that there should be no other folders in the folder. Renaming files or adding new files after the recovery is created will break everything. The algorithm is based on XOR using a hash to detect corruption and then iterating through all 65536 bytes in the block until the hash function matches. How to use: 0. Install numba: pip install numba 1. Place the RECXORF.py to the file folder 2. Use the terminal to go to the same folder (cd) 3. python RECXORF.py Files "RECXORF.py " and "recxorf" are ignored during processing.
2024-01-20 09:12:42
A variant of the script for working with a single file, the path is set at the bottom of the code.
2024-01-20 12:03:00
It uses Reed–Solomon error correction. This is a much more complex and powerful method, which is much better in terms of the effective repair of information. But it's very, very, very slow. That's why I wrote mine. My algorithm, when working on 1 thread, creates recovery blocks with disk write speed.
yurume
2024-01-20 12:08:44
I guess you rely on cryptographic hashes to detect corruptions and can only correct a single byte per each 64K block, okay? the former is okay, but I'm not sure about the latter.
2024-01-20 12:10:12
for example, faulty network transmission may result in a burst error that your scheme would be never able to correct...
lonjil
2024-01-20 12:20:36
incidentally, I'm going to develop a new parchive tool soon
DZgas Ж
yurume for example, faulty network transmission may result in a burst error that your scheme would be never able to correct...
2024-01-20 12:51:40
If there is a byte shift, then yes. But I did my own thing precisely because I have to move terabytes between HDD disks, and 1-2 bytes of errors appear there, which are shit
yurume
2024-01-20 12:52:29
in that case you don't even need a per-block checksum, you can just verify and if needed recover opportunistically.
DZgas Ж
yurume in that case you don't even need a per-block checksum, you can just verify and if needed recover opportunistically.
2024-01-20 12:54:59
That would be extremely long. If anything, I checked if also Bruteforce all the byte options until it matches the hash amount, this also works when it's only about 1 byte. but then you have to make a hash larger, 64 or 80 bits, and all this loses its meaning.
spider-mario
lonjil incidentally, I'm going to develop a new parchive tool soon
2024-01-20 12:55:05
what’s your motivation for doing so? will it work with the same format or would you be changing that too?
lonjil
DZgas Ж It uses Reed–Solomon error correction. This is a much more complex and powerful method, which is much better in terms of the effective repair of information. But it's very, very, very slow. That's why I wrote mine. My algorithm, when working on 1 thread, creates recovery blocks with disk write speed.
2024-01-20 12:55:47
hm, erasure coding in zfs works at disk write speed unless you have a very fast disk. I wonder what the difference is there?
yurume
DZgas Ж That would be extremely long. If anything, I checked if also Bruteforce all the byte options until it matches the hash amount, this also works when it's only about 1 byte. but then you have to make a hash larger, 64 or 80 bits, and all this loses its meaning.
2024-01-20 12:57:14
maybe you should try Merkle trees if that's your concern.
lonjil
spider-mario what’s your motivation for doing so? will it work with the same format or would you be changing that too?
2024-01-20 12:58:03
the ones that exist seem very focused on the usenet usecase, while I'm more interested in durable distributed storage. someone pointed out that while that may be true, the format itself may still be good for my usecases, so I probably don't need to make a new format. though making a format with stronger recovery guarantees for common storage failure modes is something I might look at later.
DZgas Ж
lonjil hm, erasure coding in zfs works at disk write speed unless you have a very fast disk. I wonder what the difference is there?
2024-01-20 12:58:21
it's not about the speed of the disk, but reed solomon is just slow on any cpu - much slower than the speed of reading data
yurume
2024-01-20 12:58:43
you still keep hashing 64K blocks, but they are increasingly merged into a single hash covering larger "blocks", and eventually a single hash for the entirety. if that doesn't match, you can traverse down to the actual block(s) that had an error in log time.
DZgas Ж
yurume maybe you should try Merkle trees if that's your concern.
2024-01-20 01:00:49
I was thinking of using this when I thought that there might be a problem when 2 bytes are broken in 1 block, but at the same time there are no broken bytes(or only one broken per block) in the largest 128 blocks. Then it would be possible to make 2 bytes of XOR for this block chain - but I just gave up on it and didn't complicate anything.
yurume
2024-01-20 01:01:16
I mean, you would keep all the intermediate hashes anyway, wouldn't you?
DZgas Ж
yurume I mean, you would keep all the intermediate hashes anyway, wouldn't you?
2024-01-20 01:02:38
I think I don't care anymore and I don't want to come up with something more complicated.
lonjil
2024-01-20 01:26:45
I suppose reed-solomon in ZFS is quite fast because it only does N+{1,2,3} parity. (where N is the number of data pieces)
2024-01-20 01:27:15
while schemes like parchive usually uses hundreds to tens of thousands of pieces total between data and parity.
spider-mario
2024-01-20 02:16:44
> In the early 20th century, an attempt was made to introduce an artificial distinction between *gray* and *grey*, with the former being used for a "mixture of white and blue", but the latter being used for a "mixture made by white and black"[1]; this has not been generally adopted.
2024-01-20 02:16:46
I’m glad it hasn’t
yoochan
spider-mario > In the early 20th century, an attempt was made to introduce an artificial distinction between *gray* and *grey*, with the former being used for a "mixture of white and blue", but the latter being used for a "mixture made by white and black"[1]; this has not been generally adopted.
2024-01-20 02:51:26
in french we should have used gris and grys ?
spider-mario
2024-01-20 02:51:56
not clear how to make the distinction orally either
diskorduser
2024-01-20 04:59:26
https://arstechnica.com/gadgets/2024/01/inventor-of-ntp-protocol-that-keeps-time-on-billions-of-devices-dies-at-age-85/
fab
2024-01-23 09:13:56
https://www.reddit.com/r/TeenagersITA/s/jGqV5nAkXv
2024-01-23 10:09:29
2024-01-23 10:09:40
I helped re a bit
JKGamer69
2024-01-23 01:18:18
Where is the gui for this?
2024-01-23 01:20:42
https://pypi.org/project/img2pdf/
Traneptora
2024-01-23 04:49:19
if you had to guess, how does this user interface work?
2024-01-23 04:49:50
Mousing over it highlights the box
2024-01-23 04:50:07
what do you think this UI widget is
2024-01-23 04:50:50
it's a toggle knob switch. clicking it toggles it to yes
2024-01-23 04:51:19
UI design is my passion
yurume
2024-01-24 01:02:29
please tell me that it shows a half of both "No" and "Yes" in the middle
Traneptora
yurume please tell me that it shows a half of both "No" and "Yes" in the middle
2024-01-24 06:31:05
no animation, it just changes instantaneously when you click it
diskorduser
2024-01-24 04:17:56
https://www.forbes.com/sites/barrycollins/2024/01/22/meet-avif-the-sharp-new-image-format-thats-set-to-replace-jpeg/
spider-mario
2024-01-24 05:01:20
> When images in both formats were shrunk down to around 80,000 bytes (0.08MB) in size, the AVIF image still looked very close to the high-quality original
2024-01-24 05:01:22
“very close”, sure
2024-01-24 05:04:33
(and why write it 0.08MB instead of 80kB?)
Oleksii Matiash
spider-mario “very close”, sure
2024-01-24 05:21:30
People used to see only "plastic" compressed to full texture loss videos from phones 🤦‍♂️
Traneptora
2024-01-24 06:18:55
forbes isn't exactly a great source of good technology info
2024-01-24 06:19:05
for example, they give you "four articles a month" for free by their paywall
2024-01-24 06:19:25
if you scroll to the bottom of the page it pops up this obnoxious "this article is paywalled" ad, and you can't scroll back up to actually read the supposed free article of four
2024-01-24 06:19:48
reloading the page uses another one of your "four free articles"
lonjil
2024-01-24 06:25:06
Also isn't that section of Forbes basically random blogs
jonnyawsom3
spider-mario “very close”, sure
2024-01-25 04:49:37
And after all that, they don't post a single image for it
lonjil
And after all that, they don't post a single image for it
2024-01-25 09:23:42
They're referring to images in that Netflix blog post, no?
spider-mario
2024-01-25 10:04:47
yes, and I had a look again, to see if I remembered it properly
2024-01-25 10:04:54
I guess it depends on your definition of “very close”
2024-01-25 10:05:15
for me, it was only true of the images that were low-quality to begin with
jonnyawsom3
2024-01-25 05:24:04
Well that's neat, guess I got water in my phone line from the storms in England lately. When I ring the home phone I get data coming out and eventual disconnect of the broadband
lonjil
2024-01-25 08:05:39
https://www.apple.com/newsroom/2024/01/apple-announces-changes-to-ios-safari-and-the-app-store-in-the-european-union/
Traneptora
2024-01-25 08:27:28
> For users, the changes include new controls and disclosures, and expanded protections to reduce privacy and security risks the DMA creates
2024-01-25 08:27:36
what security risks does the DMA create?
2024-01-25 08:29:16
> This change is a result of the DMA’s requirements, and means that EU users will be confronted with a list of default browsers before they have the opportunity to understand the options available to them. The screen also interrupts EU users’ experience the first time they open Safari intending to navigate to a webpage.
2024-01-25 08:29:24
oh man, their PR team is really salty
2024-01-25 08:30:10
I can't wait for them to go with malicious compliance and have the EU courts tell them they can't do that
2024-01-25 08:31:43
the entire article goes on about security but they won't actually say what the "security risks" are
lonjil
2024-01-25 09:29:21
https://9to5mac.com/2024/01/24/whatsapp-third-party-chats-eu-imessage/
w
2024-01-25 09:40:21
Now this is an EU fail
Traneptora
2024-01-25 09:45:51
how is it an EU fail?
2024-01-25 09:46:26
oh the interop problem
2024-01-25 09:46:28
yea that is a fail
2024-01-25 09:47:34
interop is a problem when the other chats don't have good spam filters and the like
2024-01-25 09:47:40
it's why we get garbage from the matrix bridge
lonjil
2024-01-25 09:48:41
interop doesn't mean any random spammer can just connect and send messages to anyone
w
2024-01-25 10:00:46
it's just so pointless
2024-01-25 10:00:53
i dont want everything app!!
2024-01-25 10:00:56
go away elon
lonjil
2024-01-26 09:01:43
Looks like we might get operator overloading in C2y
2024-01-26 09:06:14
Also, according to a TikTok uploaded by the C project editor, defer has been approved by the committee for C2y
diskorduser
2024-01-27 01:40:07
https://twitter.com/uwukko/status/1750815285509083630?t=8cYhl3G5S1RHNinn_vZfCQ&s=19
yurume
2024-01-27 01:54:56
I personally think C++-style operator overloading is a mistake, though I do feel needs for operator overloading in general
2024-01-27 01:57:40
the best design in my opinion comes from OCaml: https://v2.ocaml.org/manual/expr.html#sss:local-opens
2024-01-27 01:59:08
for example, `Foo.(3 + 4)` is equivalent to `Foo.(+) 3 4` (the infix `a + b` is internally `(+) a b` where `(+)` is a function with a weird name)
2024-01-27 01:59:58
so you can locally overload operators without too much complication, but the overloading is clearly indicated in the syntax. best of both worlds.
2024-01-27 02:05:07
"the inventor of the .webp file extension" *welp*
2024-01-27 02:07:09
`.png.jxl`
2024-01-27 02:07:33
at some point we will also see `.pam.jxl`
jonnyawsom3
2024-01-27 06:16:14
A friend talked about it yesterday, I guess now I know why
yurume
2024-01-27 06:33:12
people can't really distinguish lossy webp from lossless webp, sadly
2024-01-27 06:33:53
in fact, the general sentiment seems that most even don't realize that webp has a lossless codec at all
2024-01-27 06:34:16
so the fact that lossless webp *does* perform as expected doesn't help
2024-01-27 06:34:44
and is outweighted by the fact that lossy webp didn't perform as expected
2024-01-27 06:39:08
btw what did cause the introduction of lossless webp in the first place?
username
yurume btw what did cause the introduction of lossless webp in the first place?
2024-01-27 06:39:35
https://discord.com/channels/794206087879852103/804324493420920833/1082651956436291654
yurume
2024-01-27 06:39:55
oh, thanks!
jonnyawsom3
yurume people can't really distinguish lossy webp from lossless webp, sadly
2024-01-27 06:48:12
Yeah, my friend joked "You're into JXL right? We'll I've lost all hope, the guy who made WebP is on it" So I then had to explain about the lossless mode which still beats JXL occasionally too Followed up with me sending them a WebP on Telegram
yurume
username https://discord.com/channels/794206087879852103/804324493420920833/1082651956436291654
2024-01-27 06:53:41
I've found an old mozilla bug that discusses those requirements: https://bugzilla.mozilla.org/show_bug.cgi?id=600919#c83
2024-01-27 06:56:07
> From Jeff Muizlaar's blog (http://muizelaar.blogspot.com/2011/04/webp.html) we could see that the four features missing in WebP as far as Mozilla is concerned are: > * Color spaces > * Alpha channel > * EXIF (or something similar) > * ICC color profiles
2024-01-27 06:56:43
> There appears to be four simple things that Mozilla require to adopt this format: EXIF data, Alpha transparency, lossless support and i8x8 intra compression (AFAICT). That's not a lot to ask for what Google are proposing to become the worlds new standardised image format. Thus it's simply a matter of Google putting their money and resources where there mouth is and in a much more proactive manner than they've done with WebM.
2024-01-27 06:57:28
hmm, so there was no fixed set of lists arose from that bug I guess? but the general concensus was made and google devs took a notice...
veluca
2024-01-27 06:57:29
> This is even more confusing. PSNR has, for a while now, been accepted as a poor measure of visual quality and I can't understand why Google continues to use it > still true in 2024...
yurume
2024-01-27 06:57:41
great foreshadowing!
2024-01-27 06:58:45
I briefly considered a possibility that the decision to add a lossless codec was motivated by comparably poor performance of lossy codec before username posted that link
yoochan
diskorduser https://twitter.com/uwukko/status/1750815285509083630?t=8cYhl3G5S1RHNinn_vZfCQ&s=19
2024-01-27 07:53:04
The fact twitter push people, who would never do this in real life, to openly insult and threaten others, is appalling
spider-mario
2024-01-27 09:07:52
> only one person (that i know of) in the world has so far been able to use .webp without the help of format converters. oh no, _format converters_
2024-01-27 09:08:06
(as opposed to…?)
yoochan
2024-01-27 10:15:11
Shape-shifters formats ?
jonnyawsom3
2024-01-27 11:11:47
Schrodinger's File
Traneptora
spider-mario (as opposed to…?)
2024-01-27 03:35:37
probably they mean "as opposed to their software just supporting webp out of the box"
2024-01-27 03:35:44
not sure which piece of relevant software doesn't
diskorduser
2024-01-28 05:18:55
https://pbs.twimg.com/media/GE1BP6ab0AAc0Wx?format=jpg&name=large
2024-01-28 05:19:04
Interesting wallpaper
spider-mario
2024-01-30 07:37:01
https://youtu.be/Umkoxvi0QC4
2024-01-30 07:37:06
synth pop cover of the classic
DZgas Ж
2024-01-30 08:13:15
https://cdn.discordapp.com/attachments/834553178086440960/1201974010997645382/2024-01-30_21-25-08_edit_VHS.mp4
2024-01-30 08:14:57
I recorded on the real VHS: clip -【original anime MV】SHINKIRO【hololive/宝鐘マリン・Gawr Gura】 https://youtu.be/9ehwhQJ50gs
fab
2024-01-30 08:49:04