Video-equivalent of "pitch-shifting."

R

Radium

Jan 1, 1970
0
Hi:

I started a new thread because the previous one started to go into
tangent of digital vs. analog but was filled with emotions and
personal vendettas rather than science and logic. So I changed the
thread.

Anyways, Adobe Audition and voice-changers allow the frequencies of an
audio signal to be shifted w/out low-pass filtering or changing the
tempo. There are two video-equivalents of this because, while audio
has only one frequency component [temporal], video has two [temporal
and spatial].

The temporal video-equivalent would be changing the rate of back/
forth, up-down or other repetitive/cyclical movement [such as wing-
flapping or flickering of lights] of the video signal without high/low-
pass-filtering, separating any portion of the video signal, or
changing the speed at which the video-signal -- just as voice-changers
can lower the frequency of audio without changing the speed of the
audio. Using a voice-changer to decrease the pitch your voice will not
cause your speech to slow down.

The spatial video-equivalent would be changing the "sharpness" of a
still image without high/low-pass-filtering or changing the size of
the image.

Below is an example of low-pass-filtering in the spatial domain:

Here is an original picture:

http://www-dse.doc.ic.ac.uk/~nd/surprise_96/journal/vol4/sab/report.normalimage.jpg

Here is the picture after low-pass filtering:

http://www-dse.doc.ic.ac.uk/~nd/surprise_96/journal/vol4/sab/report.lopass.jpg

I obviously do not want this at all. Low-pass filtering involves
removing high-frequency components while preserving the low-frequency
components. Once again, this is not what I want. If a device cannot
handle high-frequencies, then I would like all the frequencies of the
signal to be down-shifted until the highest frequency is low-enough to
be acceptable to the device. This down-shifting should be done w/out
slowing the speed of the signal -- or in the case of spatial
frequency, w/out increasing the size of the image.


Thanks for your assistance, cooperation, and understanding,

Radium
 
B

BobG

Jan 1, 1970
0
If you play the tape or record faster, the pitch shifts up. If colors
are analogous to pitch, speeding up would be a shift to the blue,
slowing down would be a red shift.
 
J

Jerry Avins

Jan 1, 1970
0
Radium said:
Hi:

I started a new thread because the previous one started to go into
tangent of digital vs. analog but was filled with emotions and
personal vendettas rather than science and logic. So I changed the
thread.

Anyways, Adobe Audition and voice-changers allow the frequencies of an
audio signal to be shifted w/out low-pass filtering or changing the
tempo. There are two video-equivalents of this because, while audio
has only one frequency component [temporal], video has two [temporal
and spatial].

A video signal consists of a succession of still images that follow one
another at fixed intervals. What you call tempo is determined by how
different each image id from the ones before and after it. That makes
what you write next wrong.
The temporal video-equivalent would be changing the rate of back/
forth, up-down or other repetitive/cyclical movement [such as wing-
flapping or flickering of lights] of the video signal without high/low-
pass-filtering, separating any portion of the video signal, or
changing the speed at which the video-signal -- just as voice-changers
can lower the frequency of audio without changing the speed of the
audio. Using a voice-changer to decrease the pitch your voice will not
cause your speech to slow down.

The spatial video-equivalent would be changing the "sharpness" of a
still image without high/low-pass-filtering or changing the size of
the image.

Sharpness is altered by applying a filter. There are sharpening and
softening filters.
Below is an example of low-pass-filtering in the spatial domain:

Here is an original picture:

http://www-dse.doc.ic.ac.uk/~nd/surprise_96/journal/vol4/sab/report.normalimage.jpg

Here is the picture after low-pass filtering:

http://www-dse.doc.ic.ac.uk/~nd/surprise_96/journal/vol4/sab/report.lopass.jpg

I obviously do not want this at all. Low-pass filtering involves
removing high-frequency components while preserving the low-frequency
components. Once again, this is not what I want. If a device cannot
handle high-frequencies, then I would like all the frequencies of the
signal to be down-shifted until the highest frequency is low-enough to
be acceptable to the device. This down-shifting should be done w/out
slowing the speed of the signal -- or in the case of spatial
frequency, w/out increasing the size of the image.

But it together and be more specific.

Jerry
 
R

Radium

Jan 1, 1970
0
A video signal consists of a succession of still images that follow one
another at fixed intervals. What you call tempo is determined by how
different each image id from the ones before and after it. That makes
what you write next wrong.

Okay. How would you correct it?
 
A

AnthonyR.

Jan 1, 1970
0
Radium said:
Hi:

I started a new thread because the previous one started to go into
tangent of digital vs. analog but was filled with emotions and
personal vendettas rather than science and logic. So I changed the
thread.

Anyways, Adobe Audition and voice-changers allow the frequencies of an
audio signal to be shifted w/out low-pass filtering or changing the
tempo. There are two video-equivalents of this because, while audio
has only one frequency component [temporal], video has two [temporal
and spatial].

The temporal video-equivalent would be changing the rate of back/
forth, up-down or other repetitive/cyclical movement [such as wing-
flapping or flickering of lights] of the video signal without high/low-
pass-filtering, separating any portion of the video signal, or
changing the speed at which the video-signal -- just as voice-changers
can lower the frequency of audio without changing the speed of the
audio. Using a voice-changer to decrease the pitch your voice will not
cause your speech to slow down.

The spatial video-equivalent would be changing the "sharpness" of a
still image without high/low-pass-filtering or changing the size of
the image.

Below is an example of low-pass-filtering in the spatial domain:

Here is an original picture:

http://www-dse.doc.ic.ac.uk/~nd/surprise_96/journal/vol4/sab/report.normalimage.jpg

Here is the picture after low-pass filtering:

http://www-dse.doc.ic.ac.uk/~nd/surprise_96/journal/vol4/sab/report.lopass.jpg

I obviously do not want this at all. Low-pass filtering involves
removing high-frequency components while preserving the low-frequency
components. Once again, this is not what I want. If a device cannot
handle high-frequencies, then I would like all the frequencies of the
signal to be down-shifted until the highest frequency is low-enough to
be acceptable to the device. This down-shifting should be done w/out
slowing the speed of the signal -- or in the case of spatial
frequency, w/out increasing the size of the image.


Thanks for your assistance, cooperation, and understanding,

Radium

So basically you want software that analyzes each frame the way mpeg coverts
video and instead of eliminating file size by compressing the images, you
want to have it eliminate most of the static images and thus reduce file
duration instead. Is this correct?
So if a scene has movement and talking you want that left alone but if the
person is just standing still or not much action going on in the scene have
it eliminated and blended so it shortens the duration but not affecting the
movement speed thus making the scene shorter in length.
I don't know of anything that would do this to video but I could see a use
for it.
DVD player software can speed up movement by say 10% and allow the sound to
not be effected as far a pitch goes, this is useful for watching say a 2
hour and 15 minute movie on a flight that is 2 hours long.
Is this what you are trying to find?

AnthonyR.
 
J

Jerry Avins

Jan 1, 1970
0
Radium said:
Okay. How would you correct it?
I would leave out the rest of the paragraph. It's based on a false
assumption.

Jerry
 
S

Stuart

Jan 1, 1970
0
BobG said:
If you play the tape or record faster, the pitch shifts up. If colors
are analogous to pitch, speeding up would be a shift to the blue,
slowing down would be a red shift.

Sound is physical - Light is electromagnetic radiation

That would make a great Sci-Fi effect to depict 'beings' in a different
temporal dimension co-existing with us but what you describe is the effect
of motion linking the audio analogy to video which is not valid. Sound is an
air-pressure wave whose speed changes depending on the medium whereas light
is part of the electromagnetic spectrum whose speed is fixed to the speed of
light and except for some very high-end academic experiments never changes.
Never-the-less it's a good special effects used in a modified way in the BBC
production Ultra Violet.
 
G

glen herrmannsfeldt

Jan 1, 1970
0
Radium wrote:

(snip)
The temporal video-equivalent would be changing the rate of back/
forth, up-down or other repetitive/cyclical movement [such as wing-
flapping or flickering of lights] of the video signal without high/low-

It would be reasonably similar to a cyclical intensity of a lamp,
or something similar. A moving object is different.
pass-filtering, separating any portion of the video signal, or
changing the speed at which the video-signal -- just as voice-changers
can lower the frequency of audio without changing the speed of the
audio. Using a voice-changer to decrease the pitch your voice will not
cause your speech to slow down.

-- glen
 
J

Jerry Avins

Jan 1, 1970
0
Stuart said:
Sound is physical - Light is electromagnetic radiation

That would make a great Sci-Fi effect to depict 'beings' in a different
temporal dimension co-existing with us but what you describe is the effect
of motion linking the audio analogy to video which is not valid. Sound is an
air-pressure wave whose speed changes depending on the medium whereas light
is part of the electromagnetic spectrum whose speed is fixed to the speed of
light and except for some very high-end academic experiments never changes.
Never-the-less it's a good special effects used in a modified way in the BBC
production Ultra Violet.

You have very little influence on the speed of sound in the medium in
which you live.

The speed of light depends on the medium it travels through and
sometimes on the frequency. Consider a prism's dispersion.

Jerry
 
R

Radium

Jan 1, 1970
0
So basically you want software that analyzes each frame the way mpeg coverts
video and instead of eliminating file size by compressing the images, you
want to have it eliminate most of the static images and thus reduce file
duration instead. Is this correct?

I don't think so. Any thing in the video with a temporal/spatial
frequency component that is too high for a low-bandwidth device to
accept, should have all of its frequencies downshifted until the
highest frequency is low-enough for the low-bandwidth device to accept
without any aliasing or other artifacts associated with a frequency
exceeding the limits.
So if a scene has movement and talking you want that left alone but if the
person is just standing still or not much action going on in the scene have
it eliminated and blended so it shortens the duration but not affecting the
movement speed thus making the scene shorter in length.

No. The length of any parts of the movie should not be affected at
all.
DVD player software can speed up movement by say 10% and allow the sound to
not be effected as far a pitch goes, this is useful for watching say a 2
hour and 15 minute movie on a flight that is 2 hours long.
Is this what you are trying to find?

Not really. This change in video-frequency has nothing to do with
speeding up a video. The movie should remain exactly the same length.
Two hours should stay two hours.
 
S

Stuart

Jan 1, 1970
0
BobG said:
If you play the tape or record faster, the pitch shifts up. If colors
are analogous to pitch, speeding up would be a shift to the blue,
slowing down would be a red shift.


This is only true in the domestic experience using a gramophone record or
tape but in the world of TV, Film and Music Industries if a producer asks
me to speed up some dialog I will do so without affecting the pitch,
likewise I can take the pitch up without affecting the tempo. The chipmunk
sound is of course achieved by both increasing tempo and pitch. In the
analog domain this has been possible and widely used to tighten up
commercials etc since 1958 via the EMT Pitch and Tempo Regulator ( a German
invention of 8 playback heads in a rotating drum either in the direction or
in counter rotation to the linear motion of the tape) and in the modern
digital domain with a simple plug-in for programs like Adobe Audition or
Wavelab.
 
J

Jerry Avins

Jan 1, 1970
0
Radium said:
I don't think so. Any thing in the video with a temporal/spatial
frequency component that is too high for a low-bandwidth device to
accept, should have all of its frequencies downshifted until the
highest frequency is low-enough for the low-bandwidth device to accept
without any aliasing or other artifacts associated with a frequency
exceeding the limits.

Visible light extends for less than one octave, nominally from 400 to
700 nanometers. Those are wavelengths more or less centered around
500,000,000,000,000 Hz. You can't shift the band much and still see it.
No. The length of any parts of the movie should not be affected at
all.


Not really. This change in video-frequency has nothing to do with
speeding up a video. The movie should remain exactly the same length.
Two hours should stay two hours.

Describe the action of a person taking a one-mile walk and some stations
along the way.

Jerry
 
R

Radium

Jan 1, 1970
0
Radium wrote:
Visible light extends for less than one octave, nominally from 400 to
700 nanometers. Those are wavelengths more or less centered around
500,000,000,000,000 Hz. You can't shift the band much and still see it.

You're talking about color-frequency. Totally irrelevant to my
discussion of video-frequency. I am talking about temporal and spatial
frequency, not color-frequency.

Color-frequencies = frequencies of electromagnetic radiation visible
to the human eye, which as you pointed out, corresponds to wavelengths
that are at least 400 nm but no more than 700 nm.

Once again, by "video frequency", I am referring to the temporal and
spatial frequencies of the video signal, not the color-frequencies.
Describe the action of a person taking a one-mile walk and some stations
along the way.

Huh?
 
I

isw

Jan 1, 1970
0
Radium said:
Hi:

I started a new thread because the previous one started to go into
tangent of digital vs. analog but was filled with emotions and
personal vendettas rather than science and logic. So I changed the
thread.

Anyways, Adobe Audition and voice-changers allow the frequencies of an
audio signal to be shifted w/out low-pass filtering or changing the
tempo. There are two video-equivalents of this because, while audio
has only one frequency component [temporal], video has two [temporal
and spatial].

The temporal video-equivalent would be changing the rate of back/
forth, up-down or other repetitive/cyclical movement [such as wing-
flapping or flickering of lights] of the video signal without high/low-
pass-filtering, separating any portion of the video signal, or
changing the speed at which the video-signal -- just as voice-changers
can lower the frequency of audio without changing the speed of the
audio. Using a voice-changer to decrease the pitch your voice will not
cause your speech to slow down.

The spatial video-equivalent would be changing the "sharpness" of a
still image without high/low-pass-filtering or changing the size of
the image.

Below is an example of low-pass-filtering in the spatial domain:

Here is an original picture:

http://www-dse.doc.ic.ac.uk/~nd/surprise_96/journal/vol4/sab/report.normalimag
e.jpg

Here is the picture after low-pass filtering:

http://www-dse.doc.ic.ac.uk/~nd/surprise_96/journal/vol4/sab/report.lopass.jpg

I obviously do not want this at all. Low-pass filtering involves
removing high-frequency components while preserving the low-frequency
components. Once again, this is not what I want. If a device cannot
handle high-frequencies, then I would like all the frequencies of the
signal to be down-shifted until the highest frequency is low-enough to
be acceptable to the device. This down-shifting should be done w/out
slowing the speed of the signal -- or in the case of spatial
frequency, w/out increasing the size of the image.

I didn't want to post this on the original thread because it would have
been lost in the noise.

There is a very fundamental difference between a data stream
representing audio, and one representing video. Analog or digital; makes
no difference.

A stream representing audio is a continuous stream of information, with
every part of it temporally related to a specific time in the audio. It
can be slowed down, sped up, or have pieces cut out or added at will.
These last are the basis for the "speed up/slow down without changing
the pitch" algorithms.

There is absolutely no parallel to this for video, as it is handled
today. Unlike audio, video is a series of still images, equally spaced
(hopefully) in time -- i.o.w. it is always temporally quantized.

It is possible to change the spatial resolution (temporal spacing
between successive images) and the spatial resolution (within each
individual image) totally independently, and in fact, the two need to
bear no particular relation each to the other. You can create high
temporal resolution but low spatial resolution -- or the other way
around -- easily. You can also increase or reduce the temporal
resolution by interpolation/decimation while leaving the spatial
resolution totally unaffected, and you can also do the "reverse".

The fact that there is essentially no relation between these two
entities -- i.e. the data stream is comprised of a sequence of
descriptions of a series of still images -- is the reason why what you
want to do is almost certainly impossible.

If you really want to try, the first step will be to devise a method of
recording video that does not quantize the temporal axis; i.e. not using
a sequence of still images.

Good luck, and great fame awaits.

Isaac
 
Hi:

I started a new thread because the previous one started to go into
tangent of digital vs. analog but was filled with emotions and
personal vendettas rather than science and logic. So I changed the
thread.

Anyways, Adobe Audition and voice-changers allow the frequencies of an
audio signal to be shifted w/out low-pass filtering or changing the
tempo. There are two video-equivalents of this because, while audio
has only one frequency component [temporal], video has two [temporal
and spatial].

The temporal video-equivalent would be changing the rate of back/
forth, up-down or other repetitive/cyclical movement [such as wing-
flapping or flickering of lights] of the video signal without high/ low-
pass-filtering, separating any portion of the video signal, or
changing the speed at which the video-signal -- just as voice- changers
can lower the frequency of audio without changing the speed of the
audio. Using a voice-changer to decrease the pitch your voice will not
cause your speech to slow down.

The spatial video-equivalent would be changing the "sharpness" of a
still image without high/low-pass-filtering or changing the size of
the image.

Below is an example of low-pass-filtering in the spatial domain:

Here is an original picture:

http://www-dse.doc.ic.ac.uk/~nd/surprise_96/journal/vol4/sab/report.n...

Here is the picture after low-pass filtering:

http://www-dse.doc.ic.ac.uk/~nd/surprise_96/journal/vol4/sab/report.l...

I obviously do not want this at all. Low-pass filtering involves
removing high-frequency components while preserving the low- frequency
components. Once again, this is not what I want. If a device cannot
handle high-frequencies, then I would like all the frequencies of the
signal to be down-shifted until the highest frequency is low-enough to
be acceptable to the device. This down-shifting should be done w/ out
slowing the speed of the signal -- or in the case of spatial
frequency, w/out increasing the size of the image.

Thanks for your assistance, cooperation, and understanding,

Radium

I can't believe I'm jumping into this muck. Totally useless point in
that any changes in frequency leaves you with a signal you can't use.
No recorder can record it and no monitor can display it. Now if
you're willing to live within the frame/line rate definitions, then
changing frequencies _within the line frame boundaries_ would be
similar to a DVE zoom but there is much more capability than that. 25
years agon the Ampex ADO and Quantel Mirage were literally twisting
pictures into screws, making them into spheres, rolling them up. Tape
machines have been slo-mo and speeding up for over 30 years. Stuff is
way cooler now. Go look it up.

GG
 
B

BOING!!

Jan 1, 1970
0
Radium said:
Hi:

I started a new thread because the previous one started to go into
tangent of digital vs. analog but was filled with emotions and
personal vendettas rather than science and logic. So I changed the
thread.
[

Oh dear how busy you are, making up nonsense trolls! If you were serious,
you would give a couple links to youtube showing examples of spatial &
temportal "pitch shifting" video equivs
 
R

Richard Dobson

Jan 1, 1970
0
Radium wrote:
...

Wide-screen TV showing whole soccer pitch. Man in middle distance runs
from left goal to right goal. Takes 100 paces, 20 seconds. You want to
slow this down to (say) 10 paces (pedestrian equivalent to
wing-flapping). With no artifacts. Does he still reach the other goal,
in 20 seconds? Does it not look like someone running on the moon?

Richard Dobson
 
V

VelociChicken

Jan 1, 1970
0
Radium said:
Hi:

I started a new thread because the previous one started to go into
tangent of digital vs. analog but was filled with emotions and
personal vendettas rather than science and logic. So I changed the
thread.

Anyways, Adobe Audition and voice-changers allow the frequencies of an
audio signal to be shifted w/out low-pass filtering or changing the
tempo. There are two video-equivalents of this because, while audio
has only one frequency component [temporal], video has two [temporal
and spatial].

The temporal video-equivalent would be changing the rate of back/
forth, up-down or other repetitive/cyclical movement [such as wing-
flapping or flickering of lights] of the video signal without high/low-
pass-filtering, separating any portion of the video signal, or
changing the speed at which the video-signal -- just as voice-changers
can lower the frequency of audio without changing the speed of the
audio. Using a voice-changer to decrease the pitch your voice will not
cause your speech to slow down.

Mainly I don't really believe this whole question, BUT the only thing I can
think of that comes close is:

Take frames 1 to 4 of someone running for example, replace frames 2 & 3 with
a 'tween' of 1 & 4 - and so on through 4-8 etc.
That way you keep your sharpness (tween is not motion blur) yet loose half
your detail of movement. And would look very strange indeed. Probs need to
do all manner of vid tricks to tween certain films of course.

Cheers,

Dave H
 
J

Jerry Avins

Jan 1, 1970
0
Radium said:
You're talking about color-frequency. Totally irrelevant to my
discussion of video-frequency. I am talking about temporal and spatial
frequency, not color-frequency.

Describe what you mean by "video frequency". To me, it means how often
the still image that makes up the video is updated. I call it the frame
rate.
Color-frequencies = frequencies of electromagnetic radiation visible
to the human eye, which as you pointed out, corresponds to wavelengths
that are at least 400 nm but no more than 700 nm.

Once again, by "video frequency", I am referring to the temporal and
spatial frequencies of the video signal, not the color-frequencies.

Video consists of a sequence of still pictures. There are no temporal
frequencies. Spatial frequency relates to resolution.

The video is of a person walking leisurely. She covers a mile in 20
minutes. With your magic, we slow her gait to half speed, but she still
finishes that same mile in the the same 20 minutes. How?

Jerry
 
J

Jerry Avins

Jan 1, 1970
0
isw wrote:

...
Good luck, and great fame awaits.

Isaac,

If Radium doesn't take the trouble to understand your clear exposition,
he's beyond help.

Jerry
 
Top