Welcome to Doom9's Forum, THE in-place to be for everyone interested in DVD conversion.

Before you start posting please read the forum rules. By posting to this forum you agree to abide by the rules.

 

Go Back   Doom9's Forum > Video Encoding > New and alternative video codecs

Reply
 
Thread Tools Search this Thread Display Modes
Old 14th July 2017, 08:03   #21  |  Link
Jamaika
Registered User
 
Join Date: Jul 2015
Posts: 453
Perhaps, but this MagiCompress™ is archaic programs (2009). I don't see new pages.
https://wazapdark.wordpress.com/programs/
http://www.softsea.com/review/JPEG-Optimizer.html
Jamaika is offline   Reply With Quote
Old 14th July 2017, 08:14   #22  |  Link
LigH
German doom9/Gleitz SuMo
 
LigH's Avatar
 
Join Date: Oct 2001
Location: Germany, rural Altmark
Posts: 4,945
Of course, JPEG Optimizer v3.x is really old. So old that its non-resizable Common Controls file dialog shows at most 6 files in "Details" view.

But it is so efficient, optimizing JPEGs adaptively. So I always hoped anyone else might continue this general idea and enhance it by e.g. using SSIM or similar advanced metrics.

Until today, I found no alternative project. All other optimizers requantize always the whole image with the same quantizer.
__________________

German doom9 / Gleitz video board
CQME – change the Matrix!
BeSweet 1.5b31 All In One | HeadAC3he 0.24a13

Rémoulade is spoiled
LigH is offline   Reply With Quote
Old 15th July 2017, 08:04   #23  |  Link
Jamaika
Registered User
 
Join Date: Jul 2015
Posts: 453
Quote:
Originally Posted by LigH View Post
So I always hoped anyone else might continue this general idea and enhance it by e.g. using SSIM or similar advanced metrics.
I hoped on the metric VMAF so advertised.

Last edited by Jamaika; 2nd September 2017 at 10:15.
Jamaika is offline   Reply With Quote
Old 22nd July 2017, 01:03   #24  |  Link
foxyshadis
ангел смерти
 
foxyshadis's Avatar
 
Join Date: Nov 2004
Location: Lost
Posts: 9,175
MozJPEG would be a much better default than libjpeg or libjpeg-turbo, honestly. On the fast mode it's as fast as turbo, and on the slow much it's much higher quality. libjpeg is the worst of all worlds, being slow, low quality, and full of nonstandard extensions.
__________________
There are four boxes to be used in defense of liberty: soap, ballot, jury, and ammo. Please use in that order. ~ Ed Howdershelt
foxyshadis is offline   Reply With Quote
Old 22nd July 2017, 05:57   #25  |  Link
Jamaika
Registered User
 
Join Date: Jul 2015
Posts: 453
Finally foxysharis is online.
Perhaps this is my negligence, but in fact should appear new codec libjpeg 10a after two years of nonexistence. Then the turbo, no turbo versions go to the trash.

Last edited by Jamaika; 22nd July 2017 at 06:01.
Jamaika is offline   Reply With Quote
Old 25th July 2017, 07:49   #26  |  Link
Jamaika
Registered User
 
Join Date: Jul 2015
Posts: 453
New JPEG google codec:
Pik is a new lossy image format for the internet. This directory contains an encoder and a decoder for the format.

This project is in the initial research stage, please don't use it for any purpose.

The software currently requires an AVX2 and FMA capable CPU, e.g. Haswell.

Build instructions

Please ensure you have the libpng-dev and libjpeg-dev packages installed. Then simply run make -j8 , which creates cpik and dpik binaries in bin/.

The second command line argument to cpik is a Butteraugli distance (see http://github.com/google/butteraugli), which indicates the largest acceptable error. Larger values lead to smaller files and lower quality. Try 1.0 for a visually lossless result.

Related projects
-Butteraugli (HVS-aware image differences)
-Brunsli (lossless JPEG repacker)
-Guetzli (JPEG encoder with denser packing)

This is not an official Google product.

https://github.com/google/pik

Last edited by Jamaika; 2nd September 2017 at 10:16.
Jamaika is offline   Reply With Quote
Old 25th July 2017, 13:20   #27  |  Link
LigH
German doom9/Gleitz SuMo
 
LigH's Avatar
 
Join Date: Oct 2001
Location: Germany, rural Altmark
Posts: 4,945
After brotli and zopfli, now also

Quote:
Originally Posted by Jamaika View Post
-Butteraugli (HVS-aware image differences)
-Brunsli (lossless JPEG repacker)
-Guetzli (JPEG encoder with denser packing)
Wer hat's erfunden?

__________________

German doom9 / Gleitz video board
CQME – change the Matrix!
BeSweet 1.5b31 All In One | HeadAC3he 0.24a13

Rémoulade is spoiled

Last edited by LigH; 25th July 2017 at 13:24.
LigH is offline   Reply With Quote
Old 5th August 2017, 22:46   #28  |  Link
Jamaika
Registered User
 
Join Date: Jul 2015
Posts: 453
Code:
Library enc/dec:  libOpenJPEG 2.1.2      [04 Aug 2017] (difficult to determine the development of the project) 
                  libWebP     0.6+       [04 Aug 2017] 
                  libPNG      1.6.32b11  [04 Aug 2017] (change version) (version 1.7.0 abandoned)
                  libTIFF     4.0.8+     [24 Jul 2017]
                  libJPEG     9.2 8bit   [21 May 2016] (abandoned project, can use mozJPEG) 
                  libLCMS     2.0.9b+    [04 Aug 2017]
                  QCMS modzilla 4.0      [16 Aug 2016] (abandoned project) 
                  libexpat    2.2.3+     [04 Aug 2017] (new version)
                  zlib        1.2.11.1b  [03 Jun 2017] (develop)
                  DNG SDK     1.4.0      [05 May 2016] (abandoned project) 
                  XMP exempi  2.5.0      [04 Aug 2017] 
                  FreeGLUT    3.0.0+     [31 Jul 2017] (difficult to determine the development of the project)
https://www.sendspace.com/file/ieqogq

Last edited by Jamaika; 5th August 2017 at 22:53.
Jamaika is offline   Reply With Quote
Old 7th August 2017, 18:58   #29  |  Link
Jamaika
Registered User
 
Join Date: Jul 2015
Posts: 453

New version codec libjpeg: 9.3 (9c) 25.07.2017
The codec is on a new website: http://jpegclub.org/reference/reference-sources/

Last edited by Jamaika; 8th October 2017 at 07:15.
Jamaika is offline   Reply With Quote
Old 10th August 2017, 18:10   #30  |  Link
Jamaika
Registered User
 
Join Date: Jul 2015
Posts: 453
New version OpenJPEG2000 2.2.0 changelog:

## [v2.2.0]("https://github.com/uclouvain/openjpeg/releases/v2.2.0" ) (2017-08-10)
[Full Changelog](https://github.com/uclouvain/openjpe...2.1.2...v2.2.0)

Last edited by Jamaika; 10th September 2017 at 13:01.
Jamaika is offline   Reply With Quote
Old 15th August 2017, 01:06   #31  |  Link
foxyshadis
ангел смерти
 
foxyshadis's Avatar
 
Join Date: Nov 2004
Location: Lost
Posts: 9,175
Wow. Thanks for following up on that, I use jasper but I think I might need to switch to openjpeg.
__________________
There are four boxes to be used in defense of liberty: soap, ballot, jury, and ammo. Please use in that order. ~ Ed Howdershelt
foxyshadis is offline   Reply With Quote
Old 15th August 2017, 06:35   #32  |  Link
Jamaika
Registered User
 
Join Date: Jul 2015
Posts: 453
Should amateur be interested which reference software jpeg2000 codec to choose?
There are different opinions. At the forum encode.ru was a suggestion to tidy up three paths to the development of JPEG2000.

Quote:
Originally Posted by thorfdbg
Quote:
Originally Posted by boxerab
You mentioned Jasper and JJ2000 as examples of JPEG 2000 reference software. Both of these projects have been abandoned, and probably pose a significant security risk to users.
Actually, the plan was to remove both implementations from the JPEG 2000 part 5 specs once OpenJPEG has been published, though it seems that both Antonin (from Intopix) and myself are currently so much involved in the JPEG XS business such that this might still take a while to materialize. I also talked to Antonin on a couple of bugs in OpenJPEG that have been fixed, though the official ISO reference software has not yet been updated, though it should...
After suggesting that the openjpeg2000 project is neglected, the creators finally added the patches.

PS The user is forced to use a specific codec, eg, libraw is assigned libjasper instead of libopenjpeg.

Last edited by Jamaika; 2nd September 2017 at 10:17.
Jamaika is offline   Reply With Quote
Old 21st August 2017, 10:01   #33  |  Link
Jamaika
Registered User
 
Join Date: Jul 2015
Posts: 453
Code:
Library enc/dec:  libOpenJPEG 2.2.0      [19 Aug 2017] 
                  libjasper   2.0.12     [01 Aug 2017]
                  libraw      0.19       [12 Aug 2017]
                  libWebP     0.6+       [19 Aug 2017] 
                  libPNG      1.6.32.rc1 [19 Aug 2017] (change version) (version 1.7.0 abandoned)
                  libTIFF     4.0.8+     [24 Jul 2017]
                  libJPEG     9.3(9c)08bit[25 Jun 2017] (can use mozJPEG 8bit)
                  libJPEG     9.3(9c)10bit[25 Jun 2017]  
                  libJPEG     9.3(9c)12bit[25 Jun 2017]  
                  libLCMS     2.0.9b+    [04 Aug 2017]
                  QCMS                   [xx xxx 2012] (abandoned project, can use version modzilla 2016) 
                  libexpat    2.2.4+     [19 Aug 2017] (new version)
                  zlib        1.2.11.1b  [03 Jun 2017] (develop)
                  DNG SDK     1.4.0      [05 May 2016] (abandoned project) 
                  XMP exempi  2.5.0      [04 Aug 2017] 
                  FreeGLUT    3.0.0+     [31 Jul 2017]
                  butteraugli            [16 Jan 2017]
                  gflags      2.2.1      [13 Jul 2017]
                  guetzli                [02 Jun 2017] (version guetzli abandoned, patches have google pik[linux])
https://www.sendspace.com/file/k7t4tl

Last edited by Jamaika; 21st August 2017 at 10:04.
Jamaika is offline   Reply With Quote
Old 10th September 2017, 12:59   #34  |  Link
Jamaika
Registered User
 
Join Date: Jul 2015
Posts: 453
The latest codec libraries:
https://www.sendspace.com/file/rhqlfv
Jamaika is offline   Reply With Quote
Old 19th September 2017, 09:56   #35  |  Link
CruNcher
Registered User
 
CruNcher's Avatar
 
Join Date: Apr 2002
Location: Germany
Posts: 4,950
Nice idea

https://github.com/khavishbhundoo/Guetzli-mjpeg

we should add some other Psy Optimizers to this not only guetzli (butteraugli)
__________________
all my compares are riddles so please try to decipher them yourselves :)

It is about Time

Join the Revolution NOW before it is to Late !

http://forum.doom9.org/showthread.php?t=168004
CruNcher is offline   Reply With Quote
Old 19th September 2017, 17:44   #36  |  Link
Jamaika
Registered User
 
Join Date: Jul 2015
Posts: 453
Thanks for the info. I didn't know that the author was doing the tests. I wonder if the project will be resumed.
Jamaika is offline   Reply With Quote
Old 30th September 2017, 22:09   #37  |  Link
Jamaika
Registered User
 
Join Date: Jul 2015
Posts: 453
Code:
Library enc/dec:  libOpenJPEG 2.3.0+     [28 Sep 2017] 
                  libJasper   2.0.14+    [01 Aug 2017]
                  libRAW      0.19+      [12 Aug 2017]
                  libWebP     0.6+       [25 Sep 2017] 
                  libPNG      1.6.35.1+  [29 Sep 2017] (change version) (version 1.7.0 abandoned)
                  libTIFF     4.0.8+     [22 Sep 2017]
                  libFliF     0.3+       [22 Sep 2017]
                  libJPEG     9.3+_08bit [16 Sep 2017] (can use mozJPEG 8bit)
                  libLCMS     2.0.9+     [28 Sep 2017]
                  QCMS                   [-- --- 2012] (abandoned project, can use version modzilla 2016) 
                  libexpat    2.2.4+     [15 Sep 2017] 
                  zlib        1.2.11.1+  [03 Jun 2017] (develop)
                  DNG SDK     1.4.0      [05 May 2016] (abandoned project) 
                  XMP exempi  2.5.0      [04 Aug 2017] 
                  FreeGLUT    3.0.0+     [31 Jul 2017]
                  butteraugli            [05 Sep 2017]
                  gflags      2.2.1      [01 Sep 2017]
                  guetzli                [31 Aug 2017] (version guetzli abandoned, patches have google_pik[linux])
https://www.sendspace.com/file/eytd1t

New patches to old codecs.

Differential pixels in JPEG files.
cjpeg_08bit.exe -maxmemory 1000000L -rgb1 -quality 94 -optimize -progressive -verbose RAW_CANON_EOS_5DS.cr2.ppm YCoCg24(444)_nearlosslessRGB24_50%size.jpg
copenjpeg2000.exe -i RAW_CANON_EOS_5DS.cr2.tiff -o YCoCg24(444)_losslessRGB24_50%size.j2k -r 6 -mct 1 -C ""
copenjpeg2000.exe -i RAW_CANON_EOS_5DS.cr2.raw -o YCoCg24(444)_losslessRGB24_50%size.j2k -r 6 -mct 1 -C "" -F 8736,5856,3,8,u@1x1:1x1:1x1 (bad convert to YCoCg)
flif.exe -e -v -m -o -k -E100 -N -Q85 -K -A -P512 RAW_CANON_EOS_5DS.cr2.ppm YCoCg48(444)_losslessRGB48_50%size.flif


The most interesting feature is that with higher image quality values the more pixel differences.
JPEG images have visible overexposure for large formats.

FliF images have streaks visible. With small quality values is as if someone painted it. Strange action, streaks are only visible for higher quality values.

Decoder OpenJPEG have a much shorter decompression time than the FFmpeg converter.

Comparing the source file with the extracted lossy file



Problem with scaling down big images:
for %%f in ("YCoCg24(444)*.jpg") do djpeg_08bit.exe -maxmemory 1000000L -scale 1/8 -bmp %%f image/%%~nf.bmp
for %%f in ("YCoCg24(444)*.j2k") do dopenjpeg2000.exe -i %%f -d x0,y0,x1,y1 (crop tools) (no scaling) -force-rgb (don't scaling RGB for RAW) -OutFor BMP -o image/%%~nf.bmp
for %%f in ("%~dp1*.flif") do flif.exe -d %%f -v -s8 (only interlace) -o image/%%~nf.png


PS OpenJPEG is 2.3.0 now
https://github.com/uclouvain/openjpe...8/CHANGELOG.md

Last edited by Jamaika; 9th October 2017 at 13:00.
Jamaika is offline   Reply With Quote
Old 9th October 2017, 14:55   #38  |  Link
Jamaika
Registered User
 
Join Date: Jul 2015
Posts: 453
Code:
Library enc/dec:  libOpenJPEG 2.3.0+     [06 Oct 2017] 
                  libJasper   2.0.14+    [01 Aug 2017]
                  libRAW      0.19+      [12 Aug 2017]
                  libWebP     0.6+       [03 Oct 2017] 
                  libPNG      1.6.35.1+  [07 Oct 2017] (change version) (version 1.7.0 abandoned)
                  libTIFF     4.0.8+     [01 Oct 2017]
                  libFliF     0.3+       [22 Sep 2017]
                  libJPEG     9.3+_08bit [24 Sep 2017] (can use mozJPEG 8bit)
                  libJPEGLS   2.0+       [08 Oct 2017]
                  libLCMS     2.0.9+     [06 Oct 2017]
                  QCMS                   [-- --- 2012] (abandoned project, can use version modzilla 2016) 
                  libexpat    2.2.4+     [04 Oct 2017] 
                  zlib        1.2.11.1+  [03 Jun 2017] (develop)
                  DNG SDK     1.4.0      [05 May 2016] (abandoned project) 
                  XMP exempi  2.5.0      [04 Aug 2017] 
                  FreeGLUT    3.0.0+     [31 Jul 2017]
                  butteraugli            [05 Sep 2017]
                  gflags      2.2.1      [01 Sep 2017]
                  guetzli                [31 Aug 2017] (version guetzli abandoned, patches have google_pik[linux])
https://www.sendspace.com/file/zy6qez
Jamaika is offline   Reply With Quote
Old 9th October 2017, 16:53   #39  |  Link
hajj_3
Registered User
 
Join Date: Mar 2004
Posts: 765
JPEG XL was announced on August 17th, it will have 60%+ better compression than JPEG and will be patent-free for the main profile: https://jpeg.org/downloads/jpegxl/jpegxl-draft_cfp.pdf

Unfortunately it won't be ratified until 2020/2021 though. Google's PIK will be ratified once it has 65% better compression than JPEG, currently it is at 55%.

There is no mention in this thread of the new HEVC-based image format HEIF which ios 11 uses by default for taking photos with: https://nokiatech.github.io/heif/technical.html support was added in MacOS High Sierra (10.13) too.

Last edited by hajj_3; 9th October 2017 at 16:58.
hajj_3 is offline   Reply With Quote
Old 9th October 2017, 18:28   #40  |  Link
Jamaika
Registered User
 
Join Date: Jul 2015
Posts: 453
Thanks for the information.

I am an amateur which better or worse trying to compile JPEG codecs, but ...
As an enthusiast forum I have to say that the creators of the JPEG codec XL have very ambitious goals. Almost unreal, but I keep my fingers crossed.
Quote:
Originally Posted by hajj_3 View Post
JPEG XL was announced on August 17th, it will have 60%+ better compression than JPEG and will be patent-free for the main profile: https://jpeg.org/downloads/jpegxl/jpegxl-draft_cfp.pdf
Unfortunately it won't be ratified until 2020/2021 though.
4.1 Uncompressed image attributes
This CfP targets image compression technology that can at least support images with the following attributes:
§ Image resolution: from thumbnail-size images up to 8K (8192x4320) and beyond
§ Component subsampling: 4:2:0, 4:2:2, and 4:4:4 should be supported
§ Component type: RGB, YCbCr
- Input type of the encoder shall match output type of the decoder.
- Internal color space conversion is permitted (as part of the proposal).
§ Different types of content, including natural, synthetic, and screen content.
§ Bit depth: 8 and 10 bit, up to 16 bit for the high quality images use case.


Quote:
Originally Posted by hajj_3 View Post
Google's PIK will be ratified once it has 65% better compression than JPEG, currently it is at 55%.
Unfortunately the codec can't be compiled after Windows so I don't pay attention to codec. I added only to set guetzli.

What interested me?
9. Context: other ongoing activities within JPEG
We want to emphasize the distinction between the proposed activity on next-generation image compression, and two other ongoing activities within JPEG: JPEG XS and High Throughput JPEG 2000.
9.1 JPEG XS
Today’s industrial applications often imply transport and storage of uncompressed images and video. This is for instance the case in video links (SMPTE Serial Digital Interface), IP transport (SMPTE ST 2022 5/6 & proprietary uncompressed RTPs), Ethernet transport (IEEE/AVB), proprietary transports, memory buffers, and omnidirectional video capture and rendering in VR applications. In this context, the JPEG committee is working on a standardization project, JPEG XS, referenced as ISO/IEC 21122, that targets a low-latency lightweight coding system aimed at supporting higher resolutions and frame rates over these channels assuring high visual quality and low latency while keeping power and bandwidth consumption within a reasonable budget. This effort will result in a highly interoperable solution.


I hope that this year will be opensource.

9.2 High Throughput JPEG 2000 (HTJ2K)
The JPEG Committee has launched the High Throughput JPEG 2000 (HTJ2K) activity, which aims to develop an alternate block coding algorithm that can be used in place of the existing block coding algorithm specified in ISO/IEC 15444-1 (JPEG 2000 Part 1). The objective is to increase throughput of JPEG 2000 while otherwise maintaining its unique combination of features, including minimizing the impact of changes on existing codestream syntax and structure, implementations, workflows and content libraries. The output of HTJ2K activity is intended to be published as Part 15 of the JPEG 2000 family of specifications (ISO/IEC 15444).


There is progress. Fixed a lot of bugs. Added thread function for decoding. But let's forget about raw files. New codecs with different subsampling don't work with ffmpeg so and all editors based on ffmpeg. There is no scaling function for 2K, 4K, 8K. Some helpful ideas still need to be added.

Quote:
Originally Posted by hajj_3 View Post
There is no mention in this thread of the new HEVC-based image format HEIF which ios 11 uses by default for taking photos with: https://nokiatech.github.io/heif/technical.html support was added in MacOS High Sierra (10.13) too.
A file may contain both image items and image sequence tracks along with other media. For example, it is possible to create a file, which includes image items or image sequence tracks conforming to HEIF, and audio and timed text tracks conforming to any derivative format of the ISOBMFF.

For me codek HEIF is a great mystery. The creators of the GPAC muxer MP4 even implemented it, but I don't know what form it ??Eg the B or P frames from the HEVC film which can't be processed into whole images.

Cool comparison to other Image Formats

Last edited by Jamaika; 9th October 2017 at 19:28.
Jamaika is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT +1. The time now is 02:21.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2017, vBulletin Solutions Inc.