JPEG XL

Info

rules 57
github 35276
reddit 647

JPEG XL

tools 4225
website 1655
adoption 20712
image-compression-forum 0

General chat

welcome 3810
introduce-yourself 291
color 1414
photography 3435
other-codecs 23765
on-topic 24923
off-topic 22701

Voice Channels

General 2147

Archived

bot-spam 4380

off-topic

DZgas Ж
2024-08-08 09:59:10
original lanczos my (selected neighbor)
2024-08-08 10:07:20
it's strange that nothing is known about this method, as if I invented it <:WTF:805391680538148936> since this method takes only the original pixels, it does not make artifacts. And as far as I know, to preserve the clarity of the image, photos, usually use neighbor. But my method is as clear as it creates fewer artifacts.
2024-08-08 10:09:30
lanczos my neighbor
2024-08-08 10:13:24
the main problem, of course, is no flexibility of the algorithm, downscale only in pixel increments for search. 2x 3x 4x. And for an extremely long time - Need to compare each pixel of the image with the sum... BUT I have a feeling that such a scaling method will perfectly fit modern compression, since sharp pixel changes will give less rounding of the coefficients, as happens with any other algorithms (blur)
2024-08-08 10:29:11
||pip install pillow|| ```python from PIL import Image def pixel_difference(pixel1, pixel2): r1, g1, b1 = pixel1 r2, g2, b2 = pixel2 return abs(r1 - r2) + abs(g1 - g2) + abs(b1 - b2) def downscale_by_closest_pixel(image): width, height = image.size new_width = width // 2 new_height = height // 2 new_image = Image.new("RGB", (new_width, new_height)) for y in range(new_height): for x in range(new_width): pixels = [image.getpixel((x * 2, y * 2)), image.getpixel((x * 2 + 1, y * 2)), image.getpixel((x * 2, y * 2 + 1)), image.getpixel((x * 2 + 1, y * 2 + 1))] r = (pixels[0][0] + pixels[1][0] + pixels[2][0] + pixels[3][0]) / 4 g = (pixels[0][1] + pixels[1][1] + pixels[2][1] + pixels[3][1]) / 4 b = (pixels[0][2] + pixels[1][2] + pixels[2][2] + pixels[3][2]) / 4 avg_pixel = (r, g, b) closest_pixel = min(pixels, key=lambda pix: pixel_difference(pix, avg_pixel)) new_image.putpixel((x, y), closest_pixel) return new_image image = Image.open("input_image.png") downscaled_image = downscale_by_closest_pixel(image) downscaled_image.save("downscale_output_image.png") ```
2024-08-08 04:33:17
No magic happened. original my lanczos
jonnyawsom3
2024-08-08 08:24:02
It's certainly sharper, but I'm not necessarily sure that's best for human viewing
DZgas Ж
It's certainly sharper, but I'm not necessarily sure that's best for human viewing
2024-08-09 01:07:13
It's all just an interesting find. an alternative and better nearest-neighbor
TheBigBadBoy - 𝙸𝚛
2024-08-09 09:50:59
on vacation and took my laptop I guess it's CPU burning time™️ <:KekDog:805390049033191445>
2024-08-09 09:51:43
only FLACs optimization tho
Just me
2024-08-13 02:09:31
I had problems using the latest Squoosh while offline today. AVIF and several others weren't available...
jonnyawsom3
2024-08-13 02:27:16
I'm surprised there's an update at all, it's essentially archived
Traneptora
2024-08-13 04:07:33
fun fact: ```c int main; ``` is a C program that compiles.
2024-08-13 04:07:48
what's it do? segfault immediately. but it *compiles*
2024-08-13 04:10:19
if you have `-Wall` it'll trigger `-Wmain` on gcc ``` test.c:1:5: warning: ‘main’ is usually a function [-Wmain] 1 | int main; | ^~~~ ```
Tirr
2024-08-13 04:10:29
so it's okay to be just any type of symbol and doesn't need to be callable
Traneptora
2024-08-13 04:11:05
to compile? yea, but if it's not callable (which it isn't) it will segfault at runtime
Tirr
2024-08-13 04:11:36
yeah definitely
2024-08-13 04:11:50
data sections are usually not executable
Traneptora
2024-08-13 04:11:51
``` $ ./test AddressSanitizer:DEADLYSIGNAL ================================================================= ==58==ERROR: AddressSanitizer: SEGV on unknown address 0x55652dfb70c0 (pc 0x55652dfb70c0 bp 0x7fff405bfa20 sp 0x7fff405bf988 T0) ==58==The signal is caused by a READ memory access. ==58==Hint: PC is at a non-executable region. Maybe a wild jump? #0 0x55652dfb70c0 in main (/home/leo/test+0x40c0) (BuildId: 79b512c24b3a4126f21787590cc20c801847ca58) #1 0x7fe79d769d4b in __libc_start_main (/usr/lib/libc.so.6+0x25d4b) (BuildId: 32a656aa5562eece8c59a585f5eacd6cf5e2307b) #2 0x55652dfb4094 in _start (/home/leo/test+0x1094) (BuildId: 79b512c24b3a4126f21787590cc20c801847ca58) AddressSanitizer can not provide additional info. SUMMARY: AddressSanitizer: SEGV (/home/leo/test+0x40c0) (BuildId: 79b512c24b3a4126f21787590cc20c801847ca58) in main ==58==ABORTING ``` luckily address sanitizer tells us this (in case we didn't know)
2024-08-13 04:12:06
that is if you run `gcc -fsanitize=address -g -o test test.c`
CrushedAsian255
Traneptora fun fact: ```c int main; ``` is a C program that compiles.
2024-08-14 02:11:25
ahh, C
username
2024-08-14 05:36:00
yes, although we could probably move this over to https://discord.com/channels/794206087879852103/805176455658733570 sooo that's where ill post answer
lonjil
2024-08-14 06:56:16
<https://www.bloomberg.com/news/articles/2024-08-13/doj-considers-seeking-google-goog-breakup-after-major-antitrust-win> > If the Justice Department pushes ahead with a breakup plan, the most likely units for divestment are the Android operating system and Google’s web browser Chrome, said the people. Officials are also looking at trying to force a possible sale of AdWords, the platform the company uses to sell text advertising, one of the people said.
_wb_
2024-08-14 04:12:59
https://x.com/EyeingAI/status/1823493962499555485?t=C-ssIlrHgWijDaqPZ-WO_A&s=19
2024-08-14 04:13:53
To me, "AI-powered camera experience" and "authentically" are hard to reconcile...
jonnyawsom3
2024-08-14 04:19:56
Every time I take a photo on my phone, I use RAW mode, then when I go though the gallery I can see how awful all the post processing is on the jpeg versions. I can only imagine how bad the Pixel could end up compared to just having a decent sensor
_wb_
2024-08-14 04:46:53
Fitting a decent sensor in a thin device is tricky. Maybe we need some more innovation in phone form factors besides the "rounded rectangle that is as thin as possible" and come up with a design that somehow allows fitting a real camera while still being convenient to carry around and use.
jonnyawsom3
2024-08-14 04:54:14
Instead of "How thin can we go before it snaps when you sit down" why not "What fits in your pocket while being full of tech"
2024-08-14 04:56:10
It'd be a whole lot easier to have competitive battery life then too, along with better heat management, larger cameras, more grip instea of glass (No need for a few hundred phone case factories...)
TheBigBadBoy - 𝙸𝚛
It'd be a whole lot easier to have competitive battery life then too, along with better heat management, larger cameras, more grip instea of glass (No need for a few hundred phone case factories...)
2024-08-14 05:20:31
https://ae-pic-a1.aliexpress-media.com/kf/Sf952df64be8f4030b87e1f4f9d3bf798o/8849-Tank-3-Pro-by-Unihertz-with-100-Lumens-120Hz-Projector-32GB-36GB-RAM-512GB-ROM.jpg_350x350xz.jpg_.webp
2024-08-14 05:20:45
<:CatSmile:805382488293244929>
jonnyawsom3
TheBigBadBoy - 𝙸𝚛 https://ae-pic-a1.aliexpress-media.com/kf/Sf952df64be8f4030b87e1f4f9d3bf798o/8849-Tank-3-Pro-by-Unihertz-with-100-Lumens-120Hz-Projector-32GB-36GB-RAM-512GB-ROM.jpg_350x350xz.jpg_.webp
2024-08-14 05:22:08
I was thinking more like this, but yeah https://www.aliexpress.com/item/1005005007646231.html
TheBigBadBoy - 𝙸𝚛
2024-08-14 05:23:41
mmmh for only 200€ cheaper, its specs aren't really good...
jonnyawsom3
2024-08-14 05:27:59
Mostly just sent it for the thermal camera and (realistic) battery, but it is a few years old now too
Oleksii Matiash
Mostly just sent it for the thermal camera and (realistic) battery, but it is a few years old now too
2024-08-14 06:02:21
I bought separate thermal camera, needs usb type-c. I hope it will outlive more than one phone
gb82
_wb_ https://x.com/EyeingAI/status/1823493962499555485?t=C-ssIlrHgWijDaqPZ-WO_A&s=19
2024-08-14 11:39:10
I'm really not liking the Pixel 9 & its messaging...
Quackdoc
_wb_ Fitting a decent sensor in a thin device is tricky. Maybe we need some more innovation in phone form factors besides the "rounded rectangle that is as thin as possible" and come up with a design that somehow allows fitting a real camera while still being convenient to carry around and use.
2024-08-14 11:57:28
the last time sony thought it was a good idea, they gave us this monstrosity https://media.wired.com/photos/59332849a4b3d04a47189786/master/w_2240,c_limit/0903_qx10phone_1200.jpg
2024-08-14 11:59:38
sony's old pro 1 was neat, packed a 1" sensor https://electronics.sony.com/mobile/smartphone/professional-smartphones/p/xqbe62-b same with their new xperia 1v and 2v have a not bad one either https://www.galaxus.at/en/page/how-much-of-a-professional-camera-is-the-sony-xperia-1-v-28574
2024-08-15 12:00:13
not as neat as packing a full 1" sensor, or just a dedicated camera module tho
Bounnie
2024-08-15 06:07:42
do any of you devs have a donation page like pateon, kofi... crypto address?
2024-08-15 06:07:58
coz
2024-08-15 06:07:59
like
2024-08-15 06:08:08
I wanna support
2024-08-15 06:08:20
but I'm just about the dumbest you can find in the case of computers
2024-08-15 06:09:04
(that crypto thing my cousin manages for me lol)
Quackdoc
2024-08-15 07:02:08
continuing from <#794206170445119489>
2024-08-15 07:02:09
https://github.com/reubeno/brush
2024-08-15 07:02:23
rust shell with bash compatibility, allegedly works on windows
2024-08-15 07:03:19
> brush is functional for interactive use as a daily driver. It can execute most sh and bash scripts we've encountered, but still a work in progress with known limitations.
Bounnie
2024-08-15 05:43:20
fiar
2024-08-15 05:43:22
*fair
spider-mario
2024-08-15 07:21:17
that reminds me that I have yet to try out the light pollution filter I bought a while back
Oleksii Matiash
2024-08-15 08:13:00
Processed them before dxo\topaz\adobe AI denoiser were invented, and was not in the mood to reprocess since then
cutename
2024-08-18 01:18:52
https://www.youtube.com/watch?v=RFWJM8JMXBs
2024-08-18 01:19:26
ANS explainer mentioning JXL and that software patents are the devil
lonjil
2024-08-18 07:24:08
disinformation
2024-08-18 07:24:18
Microsoft does not have a patent on ANS
username
2024-08-18 07:43:01
wouldn't the Linux kernel be in trouble if this was true? like why is it/this only ever brought up in the context of JPEG XL?
2024-08-18 07:44:13
https://discord.com/channels/794206087879852103/822105409312653333/1274702220499357830
lonjil
2024-08-18 07:45:48
it's only brought up in the context of JXL because some idiot who was covering the patent saw that JXL has it and concluded that that *must* be why Google removed it
2024-08-18 07:45:59
and the basic idea has just been getting parroted since
A homosapien
2024-08-18 08:34:21
Misinformation spreads faster than the truth
_jjennnty~
lonjil Microsoft does not have a patent on ANS
2024-08-19 04:03:25
hello, i made this video and i'd also like to clear this up! someone else commented worried they'd violate this patent if they implemented something similar. i'll edit my pinned comment; what exactly is the microsoft patent on? and is it something people should worry about anyway?
username
_jjennnty~ hello, i made this video and i'd also like to clear this up! someone else commented worried they'd violate this patent if they implemented something similar. i'll edit my pinned comment; what exactly is the microsoft patent on? and is it something people should worry about anyway?
2024-08-19 04:13:18
these old messages might be relevant?: https://discord.com/channels/794206087879852103/805176455658733570/1037250264387829770 https://discord.com/channels/794206087879852103/803574970180829194/1038201223301578822 alternatively <@794205442175402004> could probably chime in and clear things up
Traneptora
_jjennnty~ hello, i made this video and i'd also like to clear this up! someone else commented worried they'd violate this patent if they implemented something similar. i'll edit my pinned comment; what exactly is the microsoft patent on? and is it something people should worry about anyway?
2024-08-19 04:32:28
microsoft patent is on a form of ANS with dynamically updating token frequencies. JXL does not do this, it signals all the frequencies at the start of the entropy stream
2024-08-19 04:33:27
but yes, see the link in Adoption
Quackdoc
2024-08-19 12:44:09
<@456226577798135808> could you tell me a bit about that build.opensuse.org thing? I see that it can build packages for other systems, I need to patch and compile mesa for an old laptop but don't know much about it. wondering how it works, I do see that it supports multiple distros which is nice since im on popOS
2024-08-19 01:08:25
yeah
2024-08-19 01:09:15
well kinda, it has a lot of their own packages and tweaks, but for mesa they use upstream ubuntu
2024-08-19 01:09:18
yeah
2024-08-19 01:11:29
havent done anything of that yet since im not sure exactly how to use this tool
2024-08-19 01:13:29
well I do have a "blank: https://build.opensuse.org/package/show/home:Quackdoc
2024-08-19 01:14:33
to be specific, it's a specifc branch im trying to build, I was hoping I could just modify the deb or something fairly easily, but I got no idea what im doing with this tool lol
2024-08-19 01:17:28
yeah
2024-08-19 01:17:37
I think I know how to start at least, thanks
2024-08-19 01:18:19
how did you find one using debian so fast tho [Hmm](https://cdn.discordapp.com/emojis/1113499891314991275.webp?size=48&quality=lossless&name=Hmm)
2024-08-19 01:26:51
ahh I see thanks, this gives me a lot to work with
Oleksii Matiash
2024-08-20 08:52:55
Google translated: *In addition to improvements to HDR video streaming, the Windows 11 24H2 update will also include support for compressing HDR wallpaper images in the JXR (JPEG XR) format, which is a Microsoft-exclusive technology that aims to improve on the widely used JPEG standard.* Instead of adopting JXL they are trying to force JXR. Yet another useless feature that noone will use
lonjil
2024-08-20 08:55:57
I thought Windows already supported JXR for that for years
jonnyawsom3
2024-08-20 08:56:34
Windows has had JXR for years, but I think the wallpaper support is new
Oleksii Matiash
2024-08-20 09:21:29
> Windows has had JXR for years But have anybody seen jxr in the wild? 🤷‍♂️
jonnyawsom3
2024-08-20 09:22:36
Assuming 'wild' means a source other than your own computer, then no, since only Windows itself and Nvidia driver tools support it (As far as I've seen)
username
2024-08-20 09:23:19
Internet Explorer and legacy Microsoft Edge support embedding/viewing them from what I remember
2024-08-20 09:25:21
and OS wise iirc they have been natively supported since Windows 8
Oleksii Matiash
Assuming 'wild' means a source other than your own computer, then no, since only Windows itself and Nvidia driver tools support it (As far as I've seen)
2024-08-20 09:26:18
I mean over the internet
username
2024-08-20 09:28:40
I think some CDNs back in the day used to ship JXR files to Internet Explorer users. something like: JP2 for Safari JXR for Internet Explorer WebP for Chrome JPEG for Firefox/other
_wb_
2024-08-20 11:07:19
At Cloudinary we used to deliver jxr (wdp) to IE / early Edge. But we stopped doing that a few years ago, the percentage of clients supporting jxr is too low to justify the extra encoding and storing the extra cdn cache entry...
2024-08-20 11:09:37
We're now stopping with J2K for the same reason. Next Safari version is deprecating it, and there are better options now anyway (jxl/avif/heic/webp/jpeg)
lonjil
Windows has had JXR for years, but I think the wallpaper support is new
2024-08-20 11:19:36
pretty sure wallpapers have been like, the only thing you could actually do with JXR for all these years
_wb_
2024-08-20 11:28:29
Not sure if I would actually want a wallpaper in HDR. Seems distracting...
Quackdoc
2024-08-20 11:32:44
HDR wallpapers can be really nice if you have oled screens, I particularly like starry sky HDR pictures. too bad I don't have an oled HDR device lol
CrushedAsian255
_wb_ We're now stopping with J2K for the same reason. Next Safari version is deprecating it, and there are better options now anyway (jxl/avif/heic/webp/jpeg)
2024-08-20 11:45:35
Just wondering what is the order of precedence for Cloudinary?
2024-08-20 11:45:55
I would assume it would look something like jxl/avif/webp/jpg
_wb_
2024-08-20 11:48:19
Currently we just mostly do jxl>avif>webp>jpg, but it's also a bit based on image content (and in the future it will be more than now) and desired quality, since for some images and quality points, avif>jxl and for quite a few jpeg>webp.
Quackdoc
2024-08-20 12:42:16
do you have a recent statistic on what percentage of clients advertise jxl support?
2024-08-20 12:42:33
with the new devices settling in, it should be fairly stable now methinks
_wb_
2024-08-20 02:46:26
Currently it is around 25% for us, but probably we have a bias towards North America and Europe
2024-08-20 02:47:04
(which means more iPhones)
2024-08-20 02:50:29
Around 26.5% of requests have Accept: image/jxl in the header. The real number of jxl supporting user agents is larger since requests coming from JavaScript or from native apps often don't set proper Accept headers when fetching images...
2024-08-20 02:53:52
There is still some fraction of non-updated Apple devices that don't support jxl, but most are updated now. Maybe the percentage of jxl support advertising clients will stabilize around 28-29%, and the real percentage of jxl supporting clients will be a bit over one third, for our composition of end-users.
Oleksii Matiash
_wb_ There is still some fraction of non-updated Apple devices that don't support jxl, but most are updated now. Maybe the percentage of jxl support advertising clients will stabilize around 28-29%, and the real percentage of jxl supporting clients will be a bit over one third, for our composition of end-users.
2024-08-20 03:37:29
Still "very low to no interest" © Google
gb82
_wb_ We're now stopping with J2K for the same reason. Next Safari version is deprecating it, and there are better options now anyway (jxl/avif/heic/webp/jpeg)
2024-08-20 06:22:14
Do u guys serve HEIC ever?
_wb_
2024-08-20 06:32:17
Yes, some iOS apps use it. They do f_heic, it's not in f_auto.
Quackdoc
2024-08-21 05:15:06
one of the things I found funny is I actually had a noticable approvement on nintendo's website by using a redirector on my laptop lol
2024-08-21 05:16:00
I did notice some latency issues, but the website was actually somewhat responsive on my piece of trash laptop lol
2024-08-21 05:16:45
is there any strong negatives to doing this?
2024-08-21 05:22:41
sadly amazon doesn't support jxl so no such override exists for it
CrushedAsian255
Quackdoc one of the things I found funny is I actually had a noticable approvement on nintendo's website by using a redirector on my laptop lol
2024-08-21 07:11:47
what redirection thing is this?
Quackdoc
CrushedAsian255 what redirection thing is this?
2024-08-21 07:13:45
https://chromewebstore.google.com/detail/redirector/ocgpenflpmgnfapjedencafcfakcekcd?hl=en https://addons.mozilla.org/en-CA/firefox/addon/redirector/
2024-08-21 01:19:32
ok, this is neat enough to share here https://milkv.io/ruyibook
2024-08-21 01:20:14
riscv laptop with an Cortex-A76 class cpu (no RVV sadly), but the CPU is actually a real open source cpu that people contribute to https://github.com/OpenXiangShan/XiangShan
yoochan
2024-08-21 01:32:00
china is building it's independence from US/EU chips at high speed with this amazing risc V
Quackdoc
2024-08-21 01:35:55
you reading too much into this, it's still a devel device, no RVV means no vector acceleration, which means no analog to SSE/AVX,
yoochan china is building it's independence from US/EU chips at high speed with this amazing risc V
2024-08-21 01:37:28
well they already had arm
yoochan
Quackdoc well they already had arm
2024-08-21 01:40:58
not so much : https://www.reuters.com/technology/export-controls-hit-chinas-access-arms-chip-designs-ft-2022-12-14/
2024-08-21 01:41:46
but at the end, it shows that the constraints the west put on china lately just boosted the autonomy of china 😄 a loose loose operation for the west
2024-08-21 01:42:43
https://www.cnbc.com/2024/01/18/china-could-face-more-chip-restrictions-in-2024-analysts-say.html
Quackdoc
2024-08-21 01:43:09
hmm, weak in some things, not others
yoochan not so much : https://www.reuters.com/technology/export-controls-hit-chinas-access-arms-chip-designs-ft-2022-12-14/
2024-08-21 01:43:24
not really a major issue for them, since they just "dont buy it" lol
CrushedAsian255
Quackdoc you reading too much into this, it's still a devel device, no RVV means no vector acceleration, which means no analog to SSE/AVX,
2024-08-21 11:03:35
NEON?
gb82
2024-08-22 01:48:50
neon is arm
Quackdoc
CrushedAsian255 NEON?
2024-08-22 03:12:09
it would be the similar equivalent
username
2024-08-23 08:49:34
https://www.youtube.com/watch?v=3-Q87w8uhwg
diskorduser
2024-08-25 01:31:15
https://youtu.be/pJ-QoG5GXV8?si=fadUuP90s5cgddPG
DNFrozen
diskorduser https://youtu.be/pJ-QoG5GXV8?si=fadUuP90s5cgddPG
2024-08-25 12:13:49
https://www.youtube.com/watch?v=P5k2Db1SRrY
diskorduser
2024-08-25 12:14:48
I already saw it.
2024-08-25 12:43:21
https://youtu.be/ZV7ON5WjOjc?si=WOKz1rOmEnBSohLg
Managor
2024-08-26 02:45:59
https://cdn.discordapp.com/attachments/853130811581530145/1277636131051147398/368a3d397098b135.png?ex=66cde2de&is=66cc915e&hm=529e4f64d0e3b7885c164aaf18a1c8c1e5883a0ee0eb5b2ba703b270e7f648a5&
cutename
2024-08-27 05:21:25
|| mbsrtowcs (multibyte string to wide character string, restartable) strxfrm (string... transform? I think.) wcstold (wide character string to long double) ||
CrushedAsian255
cutename || mbsrtowcs (multibyte string to wide character string, restartable) strxfrm (string... transform? I think.) wcstold (wide character string to long double) ||
2024-08-27 07:54:15
is the first one a Windows thing or part of the ANSI spec?
cutename
CrushedAsian255 is the first one a Windows thing or part of the ANSI spec?
2024-08-27 07:54:29
it's part of the spec
CrushedAsian255
2024-08-27 07:55:36
I prefer C# `System.Windows.Media.TextFormatting.TextSource::GetTextEffectCharacterIndexFromTextSourceCharacterIndex`
cutename
2024-08-27 07:55:37
[C99](<https://www.dii.uchile.cl/~daespino/files/Iso_C_1999_definition.pdf>)
CrushedAsian255 I prefer C# `System.Windows.Media.TextFormatting.TextSource::GetTextEffectCharacterIndexFromTextSourceCharacterIndex`
2024-08-27 07:55:47
oh god lmao
Managor
CrushedAsian255 I prefer C# `System.Windows.Media.TextFormatting.TextSource::GetTextEffectCharacterIndexFromTextSourceCharacterIndex`
2024-08-27 06:03:24
<:Hsss:806131225278152756>
Oleksii Matiash
2024-08-27 06:45:16
Java\Kotlin is slightly less talkative 😅
spider-mario
2024-08-27 07:51:12
> <delroth> si jamais vous pouvez envoyer un message 15 ans dans le passé > <delroth> envoyez leur cette headline d'aujourd'hui > <delroth> "Microsoft donates the Mono Project to the Wine team " (translated: “if you can send a message 15 years in the past, send them this headline from today”)
DZgas Ж
2024-08-27 10:02:35
CrushedAsian255
2024-08-28 11:58:44
<@167354761270525953>
2024-08-28 11:58:54
Continuing from https://discord.com/channels/794206087879852103/822105409312653333/1278322842429030400
RaveSteel
2024-08-28 12:00:30
Regarding ChatGPT's backup strategy, the single drive where all data is kept is quite realistic. I've seen too many Youtube videos where they had just dozens of drives lying around, sans backups of course
CrushedAsian255
RaveSteel Regarding ChatGPT's backup strategy, the single drive where all data is kept is quite realistic. I've seen too many Youtube videos where they had just dozens of drives lying around, sans backups of course
2024-08-28 12:01:01
i'm also guilty of that somewhat
2024-08-28 12:01:15
currently in the process of copying my files to the NAS
RaveSteel
2024-08-28 12:01:28
I was too, until I built my server
2024-08-28 12:01:33
and my offsite server lol
CrushedAsian255
2024-08-28 12:01:33
but i still have 2 1tb hdds and a 4tb to sort through, JXL compress, and transfer
RaveSteel and my offsite server lol
2024-08-28 12:01:39
you have an offsite server?
2024-08-28 12:01:43
how much is that?
RaveSteel
2024-08-28 12:01:45
Yeah 😎
2024-08-28 12:01:51
It was ok, price wise
CrushedAsian255
2024-08-28 12:01:51
i just have NAS and then Backblaze B2
2024-08-28 12:02:09
only important stuff goes to B2 though, i don't wanna pay $65 usd per month
RaveSteel
2024-08-28 12:02:21
Understandable
CrushedAsian255
2024-08-28 12:02:32
Random data hoarding things aren’t worth it
2024-08-28 12:02:36
They’re mostly on IA
RaveSteel
2024-08-28 12:02:38
I paid around 300€ each for 4 HDDs I then put in RAIDZ1
2024-08-28 12:03:15
I don't want to talk about my main server, ouch
CrushedAsian255
2024-08-28 12:03:23
WHERE DO YOU PUT THE OFFSITE SERVER AND HOW DO YOU CONNECT TO IT?
2024-08-28 12:03:30
oops sorry all caps
2024-08-28 12:03:32
Phone
RaveSteel
2024-08-28 12:03:41
Friend's house and selfhosted VPN
CrushedAsian255
2024-08-28 12:03:52
Makes sense
RaveSteel
2024-08-28 12:03:53
Connection is slow, but it works
CrushedAsian255
2024-08-28 12:03:59
Helps if you have nerdy friends
RaveSteel
2024-08-28 12:04:38
I was thinking of putting very SFF builds in the form of Raspberry Pis and Sata SSDs at some more places
2024-08-28 12:04:58
Only for the most important data and also doesn't pull much electricity
CrushedAsian255
2024-08-28 12:05:00
My server is an old MacBook Pro connected to a VPS running Nginx tunnelling through Wireguard
jonnyawsom3
2024-08-28 12:05:02
Vibrations from my GPU's fan bearing killed both my backup drive and my main drive, thankfully I realised before they completely gave out so everything is on a single SSD now
CrushedAsian255
2024-08-28 12:05:24
SSD supremacy 😎
RaveSteel
2024-08-28 12:05:34
I couldn't bear the noise and vibrations from HDDs in my PC so I'm all SSD now
CrushedAsian255
Vibrations from my GPU's fan bearing killed both my backup drive and my main drive, thankfully I realised before they completely gave out so everything is on a single SSD now
2024-08-28 12:05:35
How much data do yall have in TB?
jonnyawsom3
2024-08-28 12:06:42
It's a single 2 TB drive, and I already deleted around 1 TB of old videos that I never really used a few months ago, so at 1.4 TB right now
RaveSteel
CrushedAsian255 My server is an old MacBook Pro connected to a VPS running Nginx tunnelling through Wireguard
2024-08-28 12:07:00
Like this? xddd
CrushedAsian255
2024-08-28 12:07:03
I have around 8-9tb + backups but most is due to the fact I use ProRAW
RaveSteel Like this? xddd
2024-08-28 12:07:08
Yes
2024-08-28 12:07:16
I should add a sign to mine
RaveSteel
RaveSteel Like this? xddd
2024-08-28 12:07:56
I have seen setups like this, but turned headless by removing the screen lmao
CrushedAsian255
2024-08-28 12:08:00
It’s decently powerful but also quite loud with the fan
RaveSteel
CrushedAsian255 How much data do yall have in TB?
2024-08-28 12:08:36
Not enough lmao
CrushedAsian255
RaveSteel I have seen setups like this, but turned headless by removing the screen lmao
2024-08-28 12:08:37
I personally like the screen there so I can use it directly if something breaks
RaveSteel
2024-08-28 12:08:45
Same
jonnyawsom3
CrushedAsian255 How much data do yall have in TB?
2024-08-28 12:08:51
The same vibrations actually disconnected my SSD while in use when then issue came back. Surprised how well Windows worked running from only RAM. Only hint anything was wrong were files failing to transfer and applications refusing to open or update
RaveSteel
2024-08-28 12:09:04
PiKVM is a nice little project for otherwise headless servers
CrushedAsian255
The same vibrations actually disconnected my SSD while in use when then issue came back. Surprised how well Windows worked running from only RAM. Only hint anything was wrong were files failing to transfer and applications refusing to open or update
2024-08-28 12:09:14
If you have more ram it can cache more
jonnyawsom3
2024-08-28 12:09:27
16 GB, so nothing special
CrushedAsian255
2024-08-28 12:09:34
Huh
2024-08-28 12:09:50
Well I guess it’s at least using spare ram to cache
RaveSteel
The same vibrations actually disconnected my SSD while in use when then issue came back. Surprised how well Windows worked running from only RAM. Only hint anything was wrong were files failing to transfer and applications refusing to open or update
2024-08-28 12:09:55
Almost the windows equivalent of running rm -rf --no-preserve-root / on linux lmao
jonnyawsom3
2024-08-28 12:10:57
It was a stressfull day, only figued out what had happened when I eventually tried changing SATA cable and it suddenly worked
2024-08-28 12:11:42
But my old backup drive got the click of death and the old main drive just goes straight into recovery so many sectors are corrupted
RaveSteel
2024-08-28 12:12:12
Sheesh
jonnyawsom3
2024-08-28 12:12:33
Weird thing is, I replaced that fan around 5 months ago, and the same fan has gone again
CrushedAsian255
2024-08-28 12:12:56
Maybe it’s getting bad power?
jonnyawsom3
2024-08-28 12:13:08
Both fans are on the same cable
2024-08-28 12:13:44
And it's definitely the bearing, I can rock the blade side to side
RaveSteel
2024-08-28 12:14:05
At 5 months you still have warranty at least
jonnyawsom3
2024-08-28 12:14:29
Well the replacement fans didn't come with a warranty, I had to replace them myself
2024-08-28 12:14:37
The GPU is almost 8 years old
RaveSteel
2024-08-28 12:15:35
An 8 year old GPU is good for anything but new games on higher settings luckily
2024-08-28 12:16:09
Except if is a gt210 or something like that lol
2024-08-28 12:16:20
Or 750 Ti
jonnyawsom3
2024-08-28 12:16:23
Runs my VR at half resolution and most times I have a CPU bottleneck anyway. Most annoying thing is I got bad silicone so it can't boost very high
2024-08-28 12:16:35
1070 TI
RaveSteel
2024-08-28 12:16:53
Quite alright
jonnyawsom3
2024-08-28 12:19:23
Been considering just spending the money so I don't have to worry about it for another decade. Get the god awful value 4060 TI 16 GB, since the VRAM is needed for VR, 2x raw performance over this one ignoring DLSS and stuff, ~~AV1 Encode~~ and uses a single 8 pin power along with the fans turning off at low temps (Should help the bearings last a lot longer....)
Oleksii Matiash
2024-08-28 01:04:52
I'd share my pain. I have 4080, and it suffered from sudden monitor signal disappearing, while everything continued running. Sometime weeks could go without problems, and sometime it happened 4-5 times per day. There are lots of useless advices over the internet, as usual, but it seems that I found one that worked. Cause is in 12VHPWR cable (native, bundled with PSU), when I changed it to 12VHPWR-to-3-PCI-E power cables adapter - issue disappeared. Now I can't close side panel of my pc case, because this adapter is not flexible enough
2024-08-28 01:09:34
This adapter 🤦‍♂️
jonnyawsom3
2024-08-28 01:35:54
Because of my system being 8 years old and almost untouched, the 8 pin connector cracked and split into individual pins when getting the GPU out to replace the fans. Part of the reason I'm even considering a 4060 since then I can just use the intact connector instead of manually pressing each wire on
RaveSteel
Oleksii Matiash I'd share my pain. I have 4080, and it suffered from sudden monitor signal disappearing, while everything continued running. Sometime weeks could go without problems, and sometime it happened 4-5 times per day. There are lots of useless advices over the internet, as usual, but it seems that I found one that worked. Cause is in 12VHPWR cable (native, bundled with PSU), when I changed it to 12VHPWR-to-3-PCI-E power cables adapter - issue disappeared. Now I can't close side panel of my pc case, because this adapter is not flexible enough
2024-08-28 11:11:46
They really need to got back to the drawing board with this standard
w
2024-08-29 10:34:10
the standard's fine
CrushedAsian255
2024-08-29 11:39:22
LETS GO i just set up ssh between my home network, a VPS and the internet
Cacodemon345
2024-08-29 03:48:11
https://www.phoronix.com/news/Rust-Linux-Maintainer-Step-Down
2024-08-29 03:48:37
Also so much this: https://www.phoronix.com/forums/forum/phoronix/latest-phoronix-articles/1488128-one-of-the-rust-linux-kernel-maintainers-steps-down-cites-nontechnical-nonsense?p=1488207#post1488207
Quackdoc
2024-08-29 03:58:29
the big thing here is pulling of LLVM which isn't really needed as we are seeing both GCC-RS and rustc_codegen_gcc which should remove the hard requirement for LLVM
lonjil
2024-08-29 09:43:58
> I often end up backporting huge drivers or components to avoid messing with these old audited and certified toolchains. Here bringing in Rust introduces llvm as a dependency. this person would probably be interested in the world Ferrocene is doing on the certified toolchain front. Once Rust support in Linux is stable, they'll probably only bumb the minimum supported version rarely, just like with GCC. > Unwrap hell? Async Rust? Rust has the "hammer and everything looks like a nail now" problem. this person is deeply unserious. "unwrap" hell is nonsense, and doesn't exist in any code written for the kernel. Async Rust is one of the best designs ever for low level stuff, it just needs some unergonomic edges sanded off. > So what would I like to get added to the kernel? Lets see, I code C/C++, Zig, Ada, Pascal, Modula-2 (here I occasionally work on the GCC frontend), Rust and E, seriously? complaining about toolchain woes and then wanting all that? And Zig is years and years away from being ready to use, not to mention being married to LLVM (for production code, their non-LLVM backend is designed to be fast and simple, to not produce efficient machine code), meanwhile Rust is very close to having two different ways of using GCC instead of LLVM.
Cacodemon345 https://www.phoronix.com/news/Rust-Linux-Maintainer-Step-Down
2024-08-29 09:44:29
here's something that the former maintainer posted for context: https://youtu.be/WiPp9YEBV0Q?t=1529
2024-08-29 09:44:50
Completely unhinged behavior from Ted Ts'o
Traneptora
lonjil here's something that the former maintainer posted for context: https://youtu.be/WiPp9YEBV0Q?t=1529
2024-08-30 03:57:33
I'm confused what he's complaining about. he's basically saying that he's allowed to change ABI/ABI semantics exposed to filesystem drivers provided he changes *every one of those* filesystem drivers to use the new semantics, and he's able to do this cause it's all in C and all upstreamed in the kernel, and he'd lose his freedom to do that if there was any rust drivers that depended on the semantics
2024-08-30 03:58:06
this freedom sounds like the kind of thing that you'd have if it's a personal project maintained by one person
2024-08-30 03:58:23
this is the kernel, why does *anyone* have the freedom to change the semantics and then fix all the upstreamed drivers that break?
2024-08-30 03:58:36
cause like, that will still break ZFS and anything not upstreamed that is used in production
Quackdoc
Traneptora I'm confused what he's complaining about. he's basically saying that he's allowed to change ABI/ABI semantics exposed to filesystem drivers provided he changes *every one of those* filesystem drivers to use the new semantics, and he's able to do this cause it's all in C and all upstreamed in the kernel, and he'd lose his freedom to do that if there was any rust drivers that depended on the semantics
2024-08-30 04:22:12
he's just speaking about the general idea of it, not that he can choose to break something. however the topic you brought upm the linux kernel takes a very "if it's not upstreamed it's not supported approach" and have made that very clear many times, but most notably during one of the many the nvidia shenanigans the issue is he is... given the benefit of the doubt, massively misinterpreting what the speaker is saying, and saying that the burden of maintaing rust would be on the programmer who does the refactoring, when it simply isn't true
lonjil
Traneptora I'm confused what he's complaining about. he's basically saying that he's allowed to change ABI/ABI semantics exposed to filesystem drivers provided he changes *every one of those* filesystem drivers to use the new semantics, and he's able to do this cause it's all in C and all upstreamed in the kernel, and he'd lose his freedom to do that if there was any rust drivers that depended on the semantics
2024-08-30 07:33:09
That is in fact how Linux kernel development works. They actually really like it when they have a chance to break out of tree modules. There have even been backports to older LTS kernels that served zero purpose other than break ZFS.
2024-08-30 07:37:22
The presentation speaker said several times that as long as anyone who makes a change can describe the new interface contract, they would be happy to fix the Rust abstractions. But they can't even create initial Rust wrappers for any fs interfaces, because there is zero documentation saying how you're supposed to use them, and the maintainers are refusing to provide any descriptions.
Traneptora
lonjil That is in fact how Linux kernel development works. They actually really like it when they have a chance to break out of tree modules. There have even been backports to older LTS kernels that served zero purpose other than break ZFS.
2024-08-30 12:15:07
This seems to contradict Linus going on record of saying "no regressions" is a policy.
lonjil
Traneptora This seems to contradict Linus going on record of saying "no regressions" is a policy.
2024-08-30 12:15:45
that only applies to interfaces exposed to userspace
2024-08-30 12:15:51
Kernel internals have *zero* stability
2024-08-30 12:16:17
Linus has a very strong opinion against stable kernel driver interfaces
Traneptora
2024-08-30 12:16:43
how does he expect to work with nvidia then
2024-08-30 12:16:59
a third party
lonjil
2024-08-30 12:17:06
Nvidia has spent 20 years keeping their out of tree module up to date whenever anything breaks
2024-08-30 12:17:36
If you use Nvidia's driver or ZFS, or any other out of tree module, you must always wait for them to update before updating your kernel if something has changed.
Traneptora
2024-08-30 12:18:03
why does linus act like nvidia is the bad guy here
lonjil
2024-08-30 12:18:43
well obviously they should open source and upstream their kernel driver
Traneptora
2024-08-30 12:18:53
...right
lonjil
2024-08-30 12:19:06
they did open source it recently though, lol
Traneptora
2024-08-30 12:19:18
Not really?
lonjil
2024-08-30 12:19:20
And Linus said recently that ever since the AI boom, Nvidia has gotten a lot easier to work with
Traneptora Not really?
2024-08-30 12:19:32
the new kernel module is open source
Traneptora
2024-08-30 12:19:54
I heard it's more complicated than that
lonjil
2024-08-30 12:20:02
The userspace drivers and the firmware are closed source
Traneptora
2024-08-30 12:20:11
Lemme find that IRC conversation
lonjil
2024-08-30 12:20:27
Just like AMD did back in like 2015, Nvidia moved tons of functionality from the kernel module to firmware
Traneptora
2024-08-30 12:20:43
oh, that's what it was
2024-08-30 12:20:55
they open sources nvidia.ko but stripped it clean
lonjil
2024-08-30 12:21:49
Fun fact: digital rights management stuff used to be in AMD's closed source kernel driver, but because they are contractually obligated to keep it secret, they had to move it all to the firmware before open sourcing.
Quackdoc
Traneptora why does linus act like nvidia is the bad guy here
2024-08-30 02:09:31
nvidia has been caught using the private internal GPL interfaces many time which has made many a lawyer angry at the linux kernel staff
2024-08-30 02:09:50
and causing many a re-write to try and prevent that from happening
2024-08-30 02:11:12
but yes, their stance is very if it's not upstream, it's not supported
lonjil
2024-08-30 03:10:38
There's no such thing as a GPL interface
2024-08-30 03:10:45
That's a made up thing
2024-08-30 03:11:15
And of course, many symbols in Linux as marked as GPL only despite obviously being too trivial for copyright.
Quackdoc
2024-08-30 03:12:42
well. tell that to the lawyers
lonjil
2024-08-30 03:12:43
For example, ZFS used to use Linux's exported symbols for Arm NEON, which are just wrappers around the relevant assembly instructions. At some point, someone decided to mark them as GPL, blocking ZFS from using them. This change was backported to every single active LTS kernel.
2024-08-30 03:13:44
Well, actually, ZFS still has the code for using those symbols, and several distros patch the kernel to remove the GPL marking :) NixOS for example
Quackdoc
2024-08-30 03:26:04
while distro's can technically, as in have the technical capability to delete a line, do this, that doesn't make it not GPL, that just makes it a GPL violation
lonjil
2024-08-30 03:29:21
simple SIMD wrappers cannot be GPL-infectious, so it cannot be a GPL violation
2024-08-30 03:29:48
You can't override copyright law by putting up a few labels
Quackdoc
2024-08-30 04:04:51
the interfaces can absolutely be GPL infectious, even simple ones
lonjil
2024-08-30 04:13:24
SIMD wrappers aren't even interfaces
2024-08-30 04:13:37
are you gonna claim that the linux devs own the Arm ISA
2024-08-30 04:14:08
and the only way anything can be GPL infectious is if you end up with a derivative work
2024-08-30 04:14:34
the GPL people have this weird idea that they get to decide what does or does not count as a derivative work, but in reality, only copyright law and courts can decide that
Quackdoc
2024-08-30 04:19:05
a wrapper is an interface, and it can be GPL'd, if you fork a code base, and add a single commit, which changes a single line, which is GPL, that codebase now effectively becomes GPL, you can GPL code now matter how trivial, ofc people can implement the code in the exact same way and not gpl it, but so long as the code is there with that commit, it's GPL
2024-08-30 04:19:30
this has caused endless headache in the past for me for sure
lonjil
2024-08-30 04:40:02
a single line is too trivial to even be covered by copyright law
2024-08-30 04:40:39
licenses aren't magic
Quackdoc
2024-08-30 04:40:42
tell that to the lawyers
lonjil
2024-08-30 04:41:30
of course lawyers are gonna be angry about bogus nonsense
spider-mario
2024-08-30 06:48:21
I was going to look up how Google v. Oracle concluded, but apparently, the conclusion was “it’s fair use so this bypasses the question of copyrightability altogether”
Demiurge
lonjil That's a made up thing
2024-08-31 07:23:37
Made up by the Linux project in order to scare people away from using/contributing to Linux?
CrushedAsian255
2024-08-31 07:24:04
GPL interface as in the names of the API?
Demiurge
2024-08-31 07:24:56
I thought the Linux authors/copyright holders made up the concept of GPL-only kernel API
2024-08-31 07:28:53
It makes me sad when some people say that Linux owes its success and popularity to GPL... rather than in spite of the GPL.
CrushedAsian255
2024-08-31 09:37:28
Why do Java developers wear glasses? Because they can’t C#
spider-mario
2024-08-31 09:41:37
https://youtu.be/mDhNQPt8An0
CrushedAsian255
spider-mario https://youtu.be/mDhNQPt8An0
2024-09-01 05:09:37
it's an NE555, of course it has such a good sense of rhythm
2024-09-02 03:46:35
bro steam using my entire GPU
2024-09-02 03:46:46
2024-09-02 12:00:55
<@226977230121598977> following from what you were doing a few weeks ago about spectrograms, apparently h.264 isn't a great audio codec
2024-09-02 12:01:05
2024-09-02 12:01:36
left half is amplitude (top = left ch, bottom = right ch, mirrored so center is lowest freq) and right is phase (same channel config)
DZgas Ж
2024-09-02 12:02:16
bad encode
CrushedAsian255
2024-09-02 12:02:44
did i forget a zero in my `-b:v` ?
DZgas Ж
CrushedAsian255
2024-09-02 12:03:24
I think using a variable density phonogram will work well. (Movietone track with variable density.)
CrushedAsian255 did i forget a zero in my `-b:v` ?
2024-09-02 12:03:43
do not use bitrate
CrushedAsian255
2024-09-02 12:03:48
so stay in time domain, don't frequency domain?
DZgas Ж do not use bitrate
2024-09-02 12:04:06
ik, im actually using `-crf`
DZgas Ж
2024-09-02 12:04:40
do you encode only sound into an image? or are you asking about something else?
CrushedAsian255
2024-09-02 12:05:07
it's just sound
2024-09-02 12:05:13
no other data
2024-09-02 12:05:26
unless i want to do a real switcharoo and put a video track encoded in the audio
DZgas Ж
CrushedAsian255
2024-09-02 12:06:05
It doesn't look presentable
CrushedAsian255
2024-09-02 12:06:53
2024-09-02 12:07:08
this works better
DZgas Ж
2024-09-02 12:07:45
the method itself does not work. you don't transmit sound at least somehow well
CrushedAsian255
2024-09-02 12:08:29
static image ?
CrushedAsian255
2024-09-02 12:08:55
?
DZgas Ж
2024-09-02 12:09:23
chrome moment
CrushedAsian255
2024-09-02 12:09:32
oh
2024-09-02 12:09:47
fellow compact mode user?
DZgas Ж chrome moment
2024-09-02 12:09:57
it's h265 so that may have screwed with it
DZgas Ж
CrushedAsian255 left half is amplitude (top = left ch, bottom = right ch, mirrored so center is lowest freq) and right is phase (same channel config)
2024-09-02 12:11:30
ok what I didn't understand is this - is the image shown on the screen an encoded and then decoded sound?
CrushedAsian255
DZgas Ж ok what I didn't understand is this - is the image shown on the screen an encoded and then decoded sound?
2024-09-02 12:13:01
yes
DZgas Ж
CrushedAsian255 yes
2024-09-02 12:13:14
what tehnology name
CrushedAsian255
2024-09-02 12:13:38
i encode `src.wav` into `video.mp4`, decode `video.mp4` to `out.wav` and mux `video.mp4` and `out.wav`
DZgas Ж what tehnology name
2024-09-02 12:13:45
ffmpeg showspectrum / spectrumsynth
2024-09-02 12:17:41
2024-09-02 12:18:03
currently testing different configs to try to get the best quality vs video bitrate
DZgas Ж
2024-09-02 12:19:32
like
2024-09-02 12:19:41
https://legacy.imagemagick.org/Usage/fourier/
CrushedAsian255
2024-09-02 12:19:53
hmm, image fourier transform?
DZgas Ж
CrushedAsian255
2024-09-02 12:21:06
I just can't figure out how the right side works. And why do we need the left part if the right one
CrushedAsian255
2024-09-02 12:21:51
it's very complex
DZgas Ж
CrushedAsian255 it's very complex
2024-09-02 12:22:46
well, I spent 3 weeks fully exploring all possible algorithms and writing my own algorithm for drawing spectrograms from scratch. So take the trouble to explain
CrushedAsian255
2024-09-02 12:23:07
i was making a joke about how the FFT uses complex numbers 🤷‍♂️
DZgas Ж
CrushedAsian255 i was making a joke about how the FFT uses complex numbers 🤷‍♂️
2024-09-02 12:26:21
wha
CrushedAsian255
2024-09-02 12:26:40
what not the FFT but the Fourier transform
2024-09-02 12:26:43
in a pure math context
DZgas Ж
DZgas Ж well, I spent 3 weeks fully exploring all possible algorithms and writing my own algorithm for drawing spectrograms from scratch. So take the trouble to explain
2024-09-02 12:28:54
2 main problems I have encountered 1. It is impossible to create a spectrogram that can be converted back into a signal. Low frequencies are completely irretrievably lost due to the window size. 2. Even if you create 2 spectrograms with phases, it will still be only approximate information about the presence of a wave that has nothing to do with reality, due to the fundamental physical Uncertainty principle of Heisenberg.
CrushedAsian255 what not the FFT but the Fourier transform
2024-09-02 12:29:37
DFT*
CrushedAsian255
2024-09-02 12:30:07
could wavelets help with issue 1?
2024-09-02 12:30:17
although heisenburg is still going to get in the way
DZgas Ж
CrushedAsian255 could wavelets help with issue 1?
2024-09-02 12:30:30
wavelet transform the same
2024-09-02 12:31:08
DFT GABOR GE RID LOW-GABOR WV1 WV2 WV3 WV4 CT CT-W
2024-09-02 12:31:42
2024-09-02 12:32:05
2024-09-02 12:33:29
1. Дискретное преобразование Фурье https://en.wikipedia.org/wiki/Discrete_Fourier_transform 2. Преобразование Вигнера — Вилла https://en.wikipedia.org/wiki/Wigner_distribution_function 3. Чирплет-преобразование https://en.wikipedia.org/wiki/Chirplet_transform 4. "Cohen's Class Reduced Interference Distributions (RID) https://en.wikipedia.org/wiki/Short-time_Fourier_transform 5. Окно Гаусса https://en.wikipedia.org/wiki/Window_function#Gaussian_window 6. Преобразование Габора https://en.wikipedia.org/wiki/Gabor_transform
2024-09-02 12:34:19
Multi-pass Chirplet transformation
CrushedAsian255
2024-09-02 12:34:50
What are the weird horizontal attract lines?
2024-09-02 12:34:56
Aliasing artefact?
DZgas Ж
2024-09-02 12:35:06
and technically, it's all exactly the same. So how do you tell me is it possible to convert the sound back if even different ways draw it differently
CrushedAsian255
2024-09-02 12:35:41
Never said you could perfectly reproduce, it’s inherently a lossy process
2024-09-02 12:35:52
I was just experimenting with ffmpeg’s spectrumsynth
DZgas Ж
CrushedAsian255 What are the weird horizontal attract lines?
2024-09-02 12:38:22
this is a really funny thing that is seen exclusively in Chirplet transformation. I have an assumption that it appears at the place where the frequencies add up. Causing a certain ringing. Which should be an artifact of the encoding of the music itself. It's different on different music. Initially, I thought it was an artifact of the 44100 sound or an artifact of the 44100 --> 48000 conversion, but perhaps it is an invisible artifact that is obtained when rendering the original music in the program where it was created.
CrushedAsian255 Never said you could perfectly reproduce, it’s inherently a lossy process
2024-09-02 12:39:35
ok...and yet it is possible to reproduce perfectly if you simply encode the information about the wave as a wave. using Movietone track with variable density.
CrushedAsian255
2024-09-02 12:40:12
Or if you encode it digitally as PCM data
DZgas Ж
DZgas Ж this is a really funny thing that is seen exclusively in Chirplet transformation. I have an assumption that it appears at the place where the frequencies add up. Causing a certain ringing. Which should be an artifact of the encoding of the music itself. It's different on different music. Initially, I thought it was an artifact of the 44100 sound or an artifact of the 44100 --> 48000 conversion, but perhaps it is an invisible artifact that is obtained when rendering the original music in the program where it was created.
2024-09-02 12:41:04
or. I wrote the function incorrectly ```py if func == "CT": # chirplet chirp_rate = 1.0 phase_sum = 0.0 for mu in range(window_size-1): t = mu - window_size // 2 if 0 <= time_index + t < N: phase_sum += math.atan2( window[mu] * math.sin(-2 * math.pi * (frequency * t + 0.5 * chirp_rate * t**2) / sample_rate), window[mu] * math.cos(-2 * math.pi * (frequency * t + 0.5 * chirp_rate * t**2) / sample_rate) ) return phase_sum / 10 / window_size ```
diskorduser
2024-09-03 01:30:01
https://www.threads.net/@dlberes/post/C_bf1ZKSrkQ/?xmt=AQGzvKregSW_bOHR_ZwxOLiOiwwIJK3WgM2T5lRaA-h87g
jonnyawsom3
2024-09-03 01:49:59
2024-09-03 01:50:05
2024-09-03 01:50:26
Ah yes, subscribing for AI generated articles instead of just asking yourself
dogelition
Ah yes, subscribing for AI generated articles instead of just asking yourself
2024-09-03 06:20:11
pretty sure he meant stories about AI, not written by AI
diskorduser
2024-09-03 06:13:38
https://www.sciencealert.com/mitochondria-dump-dna-in-the-brain-potentially-cutting-years-off-our-lives
drkt
2024-09-04 11:46:56
Can someone explain chroma and chroma subsampling to me in very broad terms? what does that `x:y:z` thing mean?
_wb_
2024-09-04 12:01:15
It's a confusing notation. Basically it means if you have two rows of x luma samples, chroma is subsampled so you have y corresponding chroma samples on the first row and z more chroma samples on the second row.
2024-09-04 12:01:41
So 4:2:0 means chroma is subsampled 2x in both directions.
2024-09-04 12:02:04
4:2:2 means chroma is subsampled 2x horizontally but not vertically
2024-09-04 12:02:53
4:4:0 means chroma is subsampled 2x vertically but not horizontally
2024-09-04 12:03:19
4:4:4 means no chroma subsampling
drkt
2024-09-04 12:03:30
Oh okay; I completely understand it, then Thank you very much
_wb_
2024-09-04 12:06:10
It is mostly a crude trick to reduce the number of samples (and thus the size of buffers, etc) to make video hardware cheaper, and kind of dates back to the time when color TV was introduced and they needed to squeeze in the chroma signal in a way that would fit the broadcasting bands that were already allocated for black&white TV.
lonjil
_wb_ It's a confusing notation. Basically it means if you have two rows of x luma samples, chroma is subsampled so you have y corresponding chroma samples on the first row and z more chroma samples on the second row.
2024-09-04 12:07:13
what does "two rows of x luma samples" mean? Like a 4x2 recangle of samples?
_wb_
2024-09-04 12:07:29
Yep
CrushedAsian255
2024-09-04 12:07:35
2024-09-04 12:07:59
although it's not usually flat boxes
2024-09-04 12:08:06
there's usually interpolation and upscaling
2024-09-04 12:08:12
depends on the implementation
_wb_
2024-09-04 12:12:51
Yeah there's the complication of the offset for the chroma samples. You can align them with luma samples (cosited) or put them in the middle of the corresponding luma samples (interstitial). When it's cosited, you basically have some pixels that are identical to the non-chroma-subsampled pixels and some pixels that have only interpolated chroma info; when it's interstitial it's more symmetric in that regard.
2024-09-04 12:13:46
See also: https://en.wikipedia.org/wiki/Chroma_subsampling#Sampling_positions
2024-09-04 12:17:52
JPEG uses interstitial subsampling, i.e. in 4:2:0 the chroma samples correspond to the center of the 2x2 box of luma samples, i.e. offset (0.5, 0.5). HEVC uses cosited subsampling, i.e. in 4:2:0 the chroma samples correspond to the top-left pixel of the 2x2 box of luma samples, i.e. offset (0, 0). MP4 uses a mix of both: horizontally it's cosited, vertically it's interstitial, i.e. in 4:2:0 the chroma samples correspond to the center-left of the 2x2 box of luma samples, i.e. offset (0, 0.5).
CrushedAsian255
2024-09-04 12:44:46
umm...
2024-09-04 12:45:01
2024-09-04 12:45:08
how does that work?
2024-09-04 12:49:28
it's my startup disk
2024-09-04 12:49:35
root file system
2024-09-04 12:50:13
> macOS is checking in background whether the program using the disk has exited which is fine for external drives
2024-09-04 12:50:19
no, im still using it
2024-09-04 12:50:21
haven't restarted
2024-09-04 12:50:38
must have been a visual error
2024-09-04 12:50:53
i was trying to unmount a network drive but Finder must have got confused
2024-09-04 12:51:46
because you can't actually unmount the root fs, it will give you resource busy
lonjil
2024-09-05 12:24:53
Since we were talking about simd dispatch in Rust, I tried sketching something out based on the struct target feature feature. I didn't want to compile rust from source, so I don't have it in this code, but I hope it will be self-explanatory enough. Can't say I'm satisfied with what I ended up with, though.
2024-09-05 08:47:03
<@179701849576833024> how are you planning to do dispatching in highway-rs?
veluca
2024-09-05 08:48:04
https://github.com/rust-lang/rust/pull/129881
lonjil
2024-09-05 09:03:58
I know about that 🙂 I meant, how are you planning to use such structs for dynamic dispatch? Trait objects? Enums? Some kind of macro magic?
veluca
2024-09-05 09:23:56
generics 🙂
CrushedAsian255
2024-09-06 12:56:08
server finally running out of space, might have to either delete or get new drives
Tirr
2024-09-06 01:05:55
I'd go add more drives
CrushedAsian255
2024-09-06 01:06:40
or compress some more of my JPEGs to JXLs
Tirr I'd go add more drives
2024-09-06 01:06:51
only thing is budget
HCrikki
2024-09-06 03:08:34
drives are cheap, better get new ones before convert. for now maybe purge some stuff - not everything is worth preserving forever on a live server
2024-09-06 03:10:02
converting to jxl only saves like 20% of existing jpgs and halves png filesize. temporary savings just buy time
jonnyawsom3
2024-09-06 03:16:10
Cheap is relative, especially when everything else is costing double nowdays...
CrushedAsian255
HCrikki drives are cheap, better get new ones before convert. for now maybe purge some stuff - not everything is worth preserving forever on a live server
2024-09-06 03:16:51
jonnyawsom3
CrushedAsian255
2024-09-06 03:20:42
💀
lonjil
2024-09-09 01:20:27
a 'nice number' is a number in any base whose square and cube together contain each digit of that base exactly once, and there is only a single known nice number: 69 69^2 = 4761 69^3 = 328509
CrushedAsian255
2024-09-09 01:29:44
nice
runr855
2024-09-09 01:48:01
Is JPEG Trust something JPEG XL specific? No mainstream information exists about the project
_wb_
2024-09-09 02:49:03
https://jpeg.org/jpegtrust/
2024-09-09 02:50:01
No, it's not jxl-specific. It's a metadata spec and it can be applied to any jpeg format (and probably even other image formats)
2024-09-09 02:51:18
Technically, it's mostly the same thing as C2PA (https://c2pa.org/), or rather, it builds on top of that.
RaveSteel
2024-09-10 07:29:09
https://www.youtube.com/watch?v=oIhCyPaDP6g
2024-09-10 07:29:24
Maybe someone wants to play around with the files in the description
2024-09-10 07:29:38
``` You feel adventurous, you have a behemoth of a computer and a fast connection? Here is a 5 second ProRes4444 16K sample with an eye-watering 15GB file size: http://bit.ly/2XRrnTB You are a wimp working on an antique home computer? Here is a 200Megapixel single frame as a JPG at a lukewarm 64MB file size: http://bit.ly/2GjQWBZ ```
DZgas Ж
2024-09-10 07:57:19
Unfortunately, there is no 1-bit image conversion algorithm that would make super maximum quality. on a very small size. So I had to invent my own combination: STRESS —> NLmeans —> adaptive threshold
2024-09-10 08:00:06
"blue noise dithering" doing good results on larger images
2024-09-10 08:00:24
but not my case
CrushedAsian255
RaveSteel ``` You feel adventurous, you have a behemoth of a computer and a fast connection? Here is a 5 second ProRes4444 16K sample with an eye-watering 15GB file size: http://bit.ly/2XRrnTB You are a wimp working on an antique home computer? Here is a 200Megapixel single frame as a JPG at a lukewarm 64MB file size: http://bit.ly/2GjQWBZ ```
2024-09-10 11:57:00
d0.5 jxl of the 200 mpx image
jonnyawsom3
2024-09-11 01:56:15
Trying to open it in Waterfox immediately caused me to go into Swapfile for some reason. 10 GB of peak memory usage with only a white screen instead of a progressive load. Afterwards it settled at around 1 GB, while Irfanview *peaked* at 1.1 GB, settling at 670 MB, only 8 MB above the image's size in memory. Impressive
username
Trying to open it in Waterfox immediately caused me to go into Swapfile for some reason. 10 GB of peak memory usage with only a white screen instead of a progressive load. Afterwards it settled at around 1 GB, while Irfanview *peaked* at 1.1 GB, settling at 670 MB, only 8 MB above the image's size in memory. Impressive
2024-09-11 01:59:28
is it any better with the beta 6.5.0 version from here? https://www.waterfox.net/download/ (it's a jump from ESR115 to ESR128 which has a way newer libjxl version)
2024-09-11 02:03:05
ESR115 uses libjxl from this commit: https://github.com/libjxl/libjxl/commit/91760e31a40fb811867fbe9bda6ddf73c962389e ESR128 uses libjxl from this commit: https://github.com/libjxl/libjxl/commit/ba1bfac861315803dc53888abddca8f665c8edf3
jonnyawsom3
2024-09-11 02:04:16
Okay, nevermind... Turns out it was zooming in with the scrollwheel that causes memory usage to exponentially grow
2024-09-11 02:07:19
I only saw the peak because I had HWinfo in the background, and suddenly noticed a lot of red numbers under memory allocation xP
CrushedAsian255
2024-09-11 02:08:56
seems like it only gives jxl decoding 1 thread
jonnyawsom3
2024-09-11 02:21:03
Went up to 60% CPU usage for me
CrushedAsian255 d0.5 jxl of the 200 mpx image
2024-09-11 02:21:18
Also why remove the file?
CrushedAsian255
2024-09-11 02:21:23
tried to edit the text
2024-09-11 02:21:24
ill reupload it
2024-09-11 02:22:09
jonnyawsom3
2024-09-11 02:29:40
Ah, thanks
DZgas Ж
2024-09-11 12:48:03
2024-09-11 12:48:56
few
CrushedAsian255
2024-09-11 01:10:57
Btw that 1.24 years
RaveSteel
2024-09-11 01:19:25
That's a lot of runtime
yoochan
2024-09-13 12:32:41
can a jpeg contains 10bit or 12bit image ? can it be wide gamut ? can phone camera somehow cram HDR images into a jpeg ?
CrushedAsian255
2024-09-13 12:33:45
10/12 bit: yes in the spec but no one implements it
2024-09-13 12:33:53
WCG: I guess with ICC profiles?
2024-09-13 12:34:25
HDR: you can either use gainmap (UltraHDR) or use the previously mentioned 10/12 bit with extra signalling
2024-09-13 12:34:32
4th solution: JPEG XT
yoochan
2024-09-13 12:34:50
sony seems to use DRO (dynamic range optimisation) but still output jpegs : https://www.institute-of-photography.com/dynamic-range-optimisation-2/
CrushedAsian255
2024-09-13 12:35:22
Do you mean HDR as in less of the image is badly exposed or HDR as in displays?
2024-09-13 12:35:45
Ofc you can do whatever preprocessing to the data before encoding to JPEG
yoochan
2024-09-13 12:35:51
ultraHDR is what google uses as an excuse not postpone the implementation of jpeg XL 😄 ?
CrushedAsian255 Ofc you can do whatever preprocessing to the data before encoding to JPEG
2024-09-13 12:36:11
indeed
CrushedAsian255
yoochan ultraHDR is what google uses as an excuse not postpone the implementation of jpeg XL 😄 ?
2024-09-13 12:36:38
Not sure, AVIF also supports native HDR
2024-09-13 12:36:43
given it’s literally just a video format
yoochan
2024-09-13 12:37:26
oki, I think I have the picture.... thanks
CrushedAsian255
2024-09-13 12:38:09
Also it’s not all of Google
2024-09-13 12:38:28
It’s specifically the AVIF team / the Chrome Codec Team
yoochan
2024-09-13 12:40:16
is an ultra HDR file a jpeg file ? where the gainmap is hidden as metadata ?
CrushedAsian255
2024-09-13 12:41:32
Not sure I don’t use it
2024-09-13 12:41:37
I use DNG and HEIC
dogelition
yoochan is an ultra HDR file a jpeg file ? where the gainmap is hidden as metadata ?
2024-09-13 12:43:45
not sure how it works on the container level, but if you decode it normally it's just a single jpeg. software that supports ultra hdr can decode the gain map (which is another jpeg) and apply it to the regular image (with a parameter for hdr headroom iirc) to "recover" the hdr image
Oleksii Matiash
yoochan can a jpeg contains 10bit or 12bit image ? can it be wide gamut ? can phone camera somehow cram HDR images into a jpeg ?
2024-09-13 12:59:25
I used wide gamut jpegs before I met jxl
jonnyawsom3
yoochan can a jpeg contains 10bit or 12bit image ? can it be wide gamut ? can phone camera somehow cram HDR images into a jpeg ?
2024-09-13 01:14:06
Yes Kinda Yes > Jpegli can be encoded with 10+ bits per component. Traditional JPEG coding solutions offer only 8 bit per component dynamics causing visible banding artifacts in slow gradients. Jpegli's 10+ bits coding happens in the original 8-bit formalism and the resulting images are fully interoperable with 8-bit viewers. 10+ bit dynamics are available as an API extension and application code changes are needed to benefit from it. You can put any ICC onto an image, but there'd probably be banding or other issues unless using jpegli for wide gamut
yoochan is an ultra HDR file a jpeg file ? where the gainmap is hidden as metadata ?
2024-09-13 01:14:59
Yes and yes
Oleksii Matiash
Yes Kinda Yes > Jpegli can be encoded with 10+ bits per component. Traditional JPEG coding solutions offer only 8 bit per component dynamics causing visible banding artifacts in slow gradients. Jpegli's 10+ bits coding happens in the original 8-bit formalism and the resulting images are fully interoperable with 8-bit viewers. 10+ bit dynamics are available as an API extension and application code changes are needed to benefit from it. You can put any ICC onto an image, but there'd probably be banding or other issues unless using jpegli for wide gamut
2024-09-13 01:21:34
For artificial images - probably, but for real world photo noise masks it pretty well, even for ProPhoto
_wb_
2024-09-13 02:03:26
The original jpeg spec has an 8-bit mode and a 12-bit mode. The de facto jpeg standard (the thing that is widely supported) is just the 8-bit mode. In 8-bit mode, the DCT coefficients are 12-bit; in 12-bit mode they are 16-bit. The extra 4 bits are needed to make a roundtrip of encode-decode at the highest quality (no quantization) almost lossless — there's still some loss, but very minor. The actual precision you can get out of 12-bit DCT coefficients is higher when a block has only low-freq info (e.g. a clear sky) and lower if it has a lot of high-freq info (e.g. grass). So the actual precision (in the pixel domain) varies, say between 7 and 11 bits. In practice, you mostly _need_ higher precision (to avoid banding etc) in regions where you happen to get it. That lucky coincidence makes it possible for jpegli to effectively get something like 10-bit precision even though it is only using the 8-bit mode. This is enough to do a reasonable job at HDR.
2024-09-13 02:09:02
All other approaches to make JPEG do HDR are basically deviating from the de facto jpeg standard: either they use 12-bit mode, or they add extra stuff (a gain map, or JPEG XT residuals) that is not implemented by current jpeg deployments. If you're going to require people to implement new stuff, you may just as well use a new format altogether. With jpegli, only de facto standard jpegs are used, and you will get a reasonable image even when using just a standard decoder (provided it properly implements color management, but that's necessary anyway). Standard decoders will only decode to 8-bit RGB so there will be some banding, but it's not _horrible_.
yoochan
2024-09-13 04:43:32
Thank you for the recap! The more I read about it, the more It seems like Google will first push ultra HDR in their android camera API as an answer for the need of HDR... Which is sad
CrushedAsian255
2024-09-14 02:09:25
for seom reason updating to macOS Sequoia cleared up 100+ GB of disk space
2024-09-14 02:09:30
must have cleaned out a bunch of old caches
2024-09-14 02:10:13
Or optimised iCloud storage or something
jonnyawsom3
2024-09-14 02:36:08
Removed old updates or something?
CrushedAsian255
2024-09-15 01:53:13
macOS clock app hitting float precision?
BabylonAS
2024-09-15 06:05:11
How do I count colors for an animated image's frame in Krita?
_wb_
2024-09-15 07:13:57
`identify -format "%k\n" imagefilename`
2024-09-15 07:14:14
if I remember correctly
spider-mario
2024-09-15 10:48:20
reporting incorrect translations to LinkedIn is a much greater pain than I would have anticipated
2024-09-15 10:48:39
they’ve now asked me to clear my cookies and to try with another browser
2024-09-15 10:49:35
(in the context menu that appears when selecting text in posts, they’ve translated “Share quote” to French as the equivalent of “Share cost estimate”)
2024-09-15 10:50:34
lonjil
2024-09-15 10:53:08
lol
2024-09-15 10:53:36
gotta be international. by throwing everything into bing translate.
spider-mario
2024-09-15 10:54:40
technically, I guess a human working with no context could make the same mistake
2024-09-15 10:54:58
“this is LinkedIn, and LinkedIn is for business, so the ‘quote’ is probably a cost estimate”
Oleksii Matiash
2024-09-16 07:19:36
Does someone here have an experience with Eigen?
spider-mario
2024-09-16 07:51:01
a little bit
Oleksii Matiash
spider-mario a little bit
2024-09-16 08:13:43
May I DM you with some (not many) questions? It will not be immediately now
spider-mario
2024-09-16 08:17:36
sure, and I'll try my best 😊
Oleksii Matiash
2024-09-16 08:18:12
Thank you!
_wb_
2024-09-16 01:39:32
my hosting service suspended my account for sneyers.info without warning, apparently because I exceeded some quota on disk usage and bandwidth
2024-09-16 01:40:22
apparently it was limited to 5 GB storage and 10 GB bandwidth
2024-09-16 01:40:59
I called them and they just bumped it up to 100 GB storage and unlimited bandwidth, for the same price as what I was paying before
spider-mario
2024-09-16 01:44:32
×20 storage? which host is it?
CrushedAsian255
2024-09-16 01:46:18
Maybe it was like a grandfathered plan
Meow
2024-09-16 01:46:27
I turned my second-hand 2012 MacBook Pro into a small server
CrushedAsian255
Meow I turned my second-hand 2012 MacBook Pro into a small server
2024-09-16 01:46:41
Same but with my 2019 MacBook Pro
2024-09-16 01:46:53
It’s a great Plex server
Meow
2024-09-16 01:47:13
It's publicly accessible with HTTPS
CrushedAsian255
2024-09-16 01:47:30
Mine or yours?
Meow
2024-09-16 01:47:42
Mine of course
CrushedAsian255
2024-09-16 01:47:47
Mine is behind a VPN and Nginx
Meow It's publicly accessible with HTTPS
2024-09-16 01:48:06
Have you got fail2ban or something?
Meow
2024-09-16 01:48:48
No as I didn't promote at all
spider-mario
2024-09-16 01:51:20
my vps does
2024-09-16 01:51:22
``` `- Actions |- Currently banned: 879 |- Total banned: 2305 ```
CrushedAsian255
2024-09-16 01:52:40
what site is it
2024-09-16 01:52:43
is it just a personal thing
spider-mario
2024-09-16 01:52:47
yeah
CrushedAsian255
2024-09-16 01:53:07
i should check my nginx logs
spider-mario
2024-09-16 01:53:12
spider-mar.io (empty), sami.photo (not empty), and another domain with a Glowing Bear on it
2024-09-16 01:53:21
funny, discord linkifies none of those
CrushedAsian255
2024-09-16 01:53:37
www.spider-mar.io
2024-09-16 01:53:39
huh
2024-09-16 01:53:40
https://spider-mar.io
2024-09-16 01:53:43
there we go
2024-09-16 01:53:47
i think it might need the schema for it to link
spider-mario
2024-09-16 01:53:53
google.com
CrushedAsian255
2024-09-16 01:53:54
youtube.com
2024-09-16 01:53:56
youtube.com/
spider-mario
2024-09-16 01:53:56
ah yeah
CrushedAsian255
2024-09-16 01:53:58
http://youtube.com
spider-mario
2024-09-16 01:54:03
www.google.com
2024-09-16 01:54:08
interesting
CrushedAsian255
2024-09-16 01:54:13
you can always do this: [spider-mar.io](spider-mar.io)
2024-09-16 01:54:14
nvm
2024-09-16 01:54:18
[spider-mar.io](https://spider-mar.io)