Welcome to Doom9's Forum, THE in-place to be for everyone interested in DVD conversion.

Before you start posting please read the forum rules. By posting to this forum you agree to abide by the rules.

 

Go Back   Doom9's Forum > Capturing and Editing Video > Avisynth Development

Reply
 
Thread Tools Search this Thread Display Modes
Old 22nd June 2003, 20:11   #1  |  Link
stickboy
AviSynth Enthusiast
 
Join Date: Jul 2002
Location: California, U.S.
Posts: 1,267
Idea: Wavsynth?

(First, I am not an audio guy (I'm not much of a video guy either), so I admittedly have no clue what I'm talking about, and this might be a useless, stupid idea.)

Avisynth is a great and unique tool for video editing, but is there anything equivalent for audio work? Sure, Avisynth has some audio functions, but they're still video-oriented; operations are done in terms of video frames, which:
  • is inconvenient--I would guess that timecodes are more natural for audio work
  • may not offer the precision that some people may need
With conventional audio editors, it usually seems hard or tedious to perform operations in a reproducible, precise, and non-destructive manner.

A scripting system could solve these issues. Do any of you think a sister program to Avisynth--one targeted toward audio--would be worthwhile? Do people who work with audio care about reproducibility, precision, and non-destructiveness?

I'm not certain if it's possible to "frame-serve" WAVE files. But even if it's not, it's okay; a tool to generate a PCM WAVE file from a script would be fine too. Outputting an uncompressed file all the time might not be so bad since the storage requirements are much more practical in comparison to video.

Furthermore, I expect that a lot of programs don't use ACM (or whatever mechanisms Windows provides) to read WAVE files, choosing instead to implement their own readers, and therefore true frame-serving might not be too useful anyway.

Any thoughts?
stickboy is offline   Reply With Quote
Old 22nd June 2003, 22:18   #2  |  Link
sh0dan
Retired AviSynth Dev ;)
 
sh0dan's Avatar
 
Join Date: Nov 2001
Location: Dark Side of the Moon
Posts: 3,480
Well - AviSynth has the full capability of being an audio processing tool. With 2.5 it has even been greatly improved, with float-point samples and (virtually) unlimited number of channels. It supports audio without video - even though it still has to go through the VFW interface. I'm not sure if there is a way of creating fake WAV-files - Anyway - SAVE As WAV is still available in VirtualDub.

However focus is mostly on the video side, as per user request, since there are no "big" demand for audio processing. So in respect to that, there has mainly been improvements in the video area.

Also the number of video plugins greatly outnumber the number of audio plugins - which in some way also reflects the usage pattern of AviSynth. I don't really believe this is just because AviSynth is video oriented - there just don't seem to be the need for it, with excellent tools like BeSweet and the like around.

I personally would like to do some more sound functions - but since I don't require them for my own work, and there isn't any big requests for it, I have stayed away from it.
__________________
Regards, sh0dan // VoxPod

Last edited by sh0dan; 22nd June 2003 at 22:37.
sh0dan is offline   Reply With Quote
Old 22nd June 2003, 22:20   #3  |  Link
jorel
Guest
 
Posts: n/a
for me,
a simple user that don't know how complex could be
develop this all seems great.
  Reply With Quote
Old 23rd June 2003, 01:37   #4  |  Link
Richard Berg
developer wannabe
 
Richard Berg's Avatar
 
Join Date: Nov 2001
Location: Brooklyn, NY
Posts: 1,211
I'm curious, do you have any suggestions on potential script syntax?

I actually do more audio work than video, and I can't imagine not having a GUI. Then again, I said the same thing about video not that long ago, so I'm willing to be convinced
Richard Berg is offline   Reply With Quote
Old 23rd June 2003, 01:52   #5  |  Link
stickboy
AviSynth Enthusiast
 
Join Date: Jul 2002
Location: California, U.S.
Posts: 1,267
Well, you would of course need a GUI application to work alongside such a system--like how VirtualDub and Avisynth work together.

In my little world I'm imagining something like Audacity (or maybe Audacity itself) that lets you graphically apply some operations, internally generates a script, and then allows you to export that script if you so desire (similar to VirtualDub's Sylia scripting system).

I don't know how the syntax should look. I don't know a thing about audio, so I have no idea what's appropriate. I'd guess something similar to Avisynth would be adequate (with the exception that functions take times as hh:mm:ss.mmmmm instead of frame numbers, and that right end-points to ranges are always exclusive).

Of course, going in another direction and using a Python- or Matlab-like syntax might be a good idea too.

Last edited by stickboy; 23rd June 2003 at 01:56.
stickboy is offline   Reply With Quote
Old 23rd June 2003, 06:53   #6  |  Link
scmccarthy
Registered User
 
Join Date: Oct 2002
Posts: 462
When 2.5 came out, I mixed left-right on the left and center-surrounds on the right. The only thing that could have made that easier is if I had read it from the ac3 file directly, rather than use BeSweet to save each channel separately.

Stephen
scmccarthy is offline   Reply With Quote
Old 23rd June 2003, 07:34   #7  |  Link
sh0dan
Retired AviSynth Dev ;)
 
sh0dan's Avatar
 
Join Date: Nov 2001
Location: Dark Side of the Moon
Posts: 3,480
btw, you should be able to use a framerate of 1000fps - that gives you 1ms precision.

However a GUI just for audio would be optimal - with the way AviSynth handles audio I see no reason for not doing a "complete" CoolEdit-like GUI. It's a lot of work, but it's doable.
__________________
Regards, sh0dan // VoxPod
sh0dan is offline   Reply With Quote
Old 23rd June 2003, 13:33   #8  |  Link
Malcolm
Registered User
 
Join Date: Sep 2002
Location: Germany
Posts: 352
Hi,

in September 2002 i posted a message about this topic (see here)
a part of this message was:
Quote:
So, what about support for existing audio-filters from other applications? Cool Edit (a Shareware-Audio App) has a Filter-SDK on it's website. www.syntrillium.com
bye,
Malcolm
Malcolm is offline   Reply With Quote
Old 23rd June 2003, 14:36   #9  |  Link
sh0dan
Retired AviSynth Dev ;)
 
sh0dan's Avatar
 
Join Date: Nov 2001
Location: Dark Side of the Moon
Posts: 3,480
Some different stuff seems to be possible:

1) Import/Export of AviSynth audio in CoolEdit. I cannot tell for sure if it is possible, but it seems like it would be possible to frameserve from CoolEdit through a filter. Importing audio from an AVS-file should also be possible.

2) Using CoolEdit plugins in AviSynth. Not at all easy - several adjustments would have to made for this to be possible (as it is almost entirely GUI-based) - I'm not even sure if it is even legal. Not much of a realistic option IMO.

3) Create a filter that allowed scripts to be generated. Actually this isn't that far off. It would allow users to select samples, and then apply a filter to the selection. It probably wouldn't be with "live updates", but that should be possible at some point.
__________________
Regards, sh0dan // VoxPod
sh0dan is offline   Reply With Quote
Old 23rd June 2003, 15:37   #10  |  Link
Malcolm
Registered User
 
Join Date: Sep 2002
Location: Germany
Posts: 352
@sh0dan
could you explain your third point in detail?

i don't really care if it's cool edit filters that we can use. if there's another good / free audio-app with a decent filter system and enough existing filters then let's use this. OR: let's look at some good / important audiofilter sources and rewrite them for avisynth! (esp. denoising!!!)

i only want to avoid having multiple gigs of wav-files (orig, normalized, denoised, etc.) for a 2 hour movie on my harddrive. Basically it's the same thing as with video: You use a certain filterchain in your avs script to avoid generating multiple gigs of (huffy-) video just as an intermediate step before mpeg2/4 compression!
Malcolm is offline   Reply With Quote
Old 23rd June 2003, 15:40   #11  |  Link
WarpEnterprises
C64
 
WarpEnterprises's Avatar
 
Join Date: Apr 2002
Location: Austria
Posts: 830
I did a short scan on the CE API. It has a PCM interface (which is basically similar to what AviSynth offers)

and a FFT interface to work in frequency domain (this is not present in AviSynth) --> maybe this is missing here to get really further?
WarpEnterprises is offline   Reply With Quote
Old 2nd July 2003, 01:36   #12  |  Link
E-Male
mad computer-scientist
 
Join Date: Mar 2002
Posts: 1,375
well, as we are on this topic:

Somethign iŽd like is this:

a fake wave file that just puts through the line-in
opening it in powerdvd/windvd/... would make it possible to use their audiofeatures (like upmix & dolbyheadphone) with the line in (for example to have dolbyheadphone with your normal tv program)

can someone please comment on how difficult this would be

thx
E-Male
E-Male is offline   Reply With Quote
Old 3rd July 2003, 09:23   #13  |  Link
FredThompson
Registered User
 
FredThompson's Avatar
 
Join Date: Feb 2002
Location: Charlotte, NC USA
Posts: 1,984
If anyone is REALLY interested in this sort of thing, please look at http://www.csounds.com first. It's a freely-usable scripting language for audio with about 450 opcodes. Also, the editor Audacity http://audacity.sourceforge.net/ and the other links on the page I maintain at Donald Graft's site. There's a wealth of material linked there. (Yes, I know the CSound link on the page is old.)

The only noise reduction I've been able to find is the VST noise gate listed on the links page and this: http://panic.et.tudelft.nl/~costar/gramofile/

Personally, all my audio sampling is done outside the computer but this would really help a lot of folks, getting rid of that system noise squiggly crackle, I mean.
__________________
Reclusive fart.
Collecting Military, Trains, Cooking, Woodworking, Fighting Illini, Auburn Tigers

Last edited by FredThompson; 3rd July 2003 at 09:35.
FredThompson is offline   Reply With Quote
Old 4th July 2003, 03:07   #14  |  Link
E-Male
mad computer-scientist
 
Join Date: Mar 2002
Posts: 1,375
csound loosk more like a synthy to me, then a wave-processor
E-Male is offline   Reply With Quote
Old 4th July 2003, 03:20   #15  |  Link
FredThompson
Registered User
 
FredThompson's Avatar
 
Join Date: Feb 2002
Location: Charlotte, NC USA
Posts: 1,984
And?...

(edit) That was a snotty reply. I shouldn't have done that.

If you poke around the csound site you'll find some GUI editors. Suppose you're editing something and want to add a drum roll or cybal crash or something like that? I don't know. Imagine anything you'd want to add music or sound effects to. What if there's a good apparent volume testing function and it could be used to bring left and right channels to the same relative volume. It's fairly common for sampled channels to have different volumes, especially with broadcast source. What if you wanted to add an echo or vibrato? Wouldn't it make sense to use a freely-available routine that's used for high quality music synthesis?

One of the major benefits of CSound is the calibre and quantity of people who use it. It gets us one step closer to a true editing suite.

Hmmm...there's an idea. I wonder what would be involved in taking one of those CSound GUIs and adding video tracks. Maybe a video clip is treated like a special type of instrument, linked by an AviSynth script. Surely there's some form of time-based composition save. Wonder if you could use it to generate a soundtrack and AviSynth script timed to it. (Not that I can do this, just wondering what might be possible since CSound is an extendable language.)

Whoa. There's an idea. I don't know the full history but AviSynth but it sure looks like something Ben did for his studies. What if some academic takes on creating an AviSynth "instrument" interface. Hmmm...

Last edited by FredThompson; 4th July 2003 at 03:48.
FredThompson is offline   Reply With Quote
Old 4th July 2003, 04:53   #16  |  Link
E-Male
mad computer-scientist
 
Join Date: Mar 2002
Posts: 1,375
just wanted to be sure
no offense intended

still looking for a way to put line-in through to programs that can play wave-files
E-Male is offline   Reply With Quote
Old 4th July 2003, 06:06   #17  |  Link
FredThompson
Registered User
 
FredThompson's Avatar
 
Join Date: Feb 2002
Location: Charlotte, NC USA
Posts: 1,984
None taken. I've had a rough couple of weeks and it sort of bubbled out right then. Sorry.

I don't understand what you are looking for. How does a WAV file redirector help with TV?

Last edited by FredThompson; 4th July 2003 at 06:17.
FredThompson is offline   Reply With Quote
Old 4th July 2003, 08:54   #18  |  Link
E-Male
mad computer-scientist
 
Join Date: Mar 2002
Posts: 1,375
the new software-dvdplayers can do an upmix to the stereo material then turn this upmix into dolbyheadphone
sounds quiet nice, iŽm still working on finding the best settings
now iŽd like to have this feature "live", so i can use my PC as a stereo to (surround to) dolbyheadphone converter
but this players only work with files and using the filters with graphedit doesnŽt work as i like it, by far not
E-Male is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT +1. The time now is 03:22.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2024, vBulletin Solutions Inc.