Marketing: I wanna find our if our remote works .
Project Manager: Me too . {vocalsound}
Marketing: Oh . {vocalsound}
Project Manager: Okay . Um here's the agenda for our last meeting .
Marketing: Whoohoo .
Project Manager: Um after the opening we're going to have a prototype presentation , then we're going to discuss the evaluation criteria and the financing of our remote . Then we're going to evaluate the product and I think the whole production process , and then we're gonna close it up , and we have forty minutes , so let's get started . Oh , no , let's have the prototype presentation .
Industrial Designer: Mm 'kay ,
User Interface: {gap}
Industrial Designer: you ready ?
User Interface: Um sure . You or me ?
Industrial Designer: Y you read that stuff , since you wrote it .
User Interface: Okay . Well , since our materials aren't exactly what we were going for , I'm just gonna translate what this all means for you .
Industrial Designer: I'll be the Vanna .
User Interface: {vocalsound} The base is gonna be gunmetal gray , which is what we had decided , and it's gonna be plastic . Um then there's the latex cover , which is what you see as red . Um because it can be replaceable , we just kinda went with the colour .
Project Manager: Right .
User Interface: Um and then the buttons are actually kind of poking through rather than on top . Um and the buttons will be a l much lighter blue , almost see-through .
Project Manager: Hmm .
User Interface: It's just sort of a very pale blue and a light-up yellow .
Marketing: That's nice .
Project Manager: Yeah .
User Interface: The whole thing lights up if you press any button , rather than it {disfmarker} just that one button will light up .
Marketing: Good .
User Interface: Um and then at the bottom we have our logo . Um bright yellow sort of design with the R_R_ {vocalsound} which will actually look like our logo .
Project Manager: {vocalsound} Great .
User Interface: And then on the side you have the buttons . {vocalsound} They're one button , but they kind of push up and down .
Project Manager: Okay .
User Interface: I don't think they're scrolling .
Industrial Designer: No . They're just buttons .
User Interface: {vocalsound} Right , yeah . And then {disfmarker} yeah , the buttons .
Industrial Designer: On off switch will be here and as you've noticed on our prototype um they've ended up with a curvature kind of , by concave sort of thing , except for , you know , {gap} can't see underneath .
Marketing: Yeah .
Industrial Designer: So I'm hoping that when we get to production we can actually make them like that , because they're very nice to stock {gap} you know , stick your finger in . Um the two squared buttons are are two probably least used , menu , mute ,
User Interface: Thumb-shaped .
Marketing: Yeah .
Industrial Designer: and then these are the numbers , so our channel and our volume will be on either side .
User Interface: Yeah . And then the last thing is just that it'll be black labelling on top , just which we didn't do . {vocalsound}
Project Manager: Okay . And did you determine um the curvature of the bottom part of it for the hand , is it gonna be a single or a double ?
User Interface: {vocalsound}
Industrial Designer: I'd say a single .
Project Manager: Single . Single sounds good ,
User Interface: Single .
Project Manager: 'cause it's not big enough to really constitute a double .
Marketing: Yeah .
Industrial Designer: Yeah , it's only actually the size of my hand .
User Interface: Right .
Project Manager: Great . Great . I think you did an awesome job .
Marketing: Yeah , I think it's a beautiful {disfmarker}
Project Manager: It is beautiful , and it's everything that we discussed .
User Interface: {vocalsound}
Marketing: Yeah . Good job , you guys .
Project Manager: Good job .
Industrial Designer: Whoohoo .
User Interface: Oh thank you . {vocalsound}
Marketing: Those are really good .
Project Manager: Alright {vocalsound}
Industrial Designer: {gap}
Project Manager: what's next in our agenda ? Um we're gonna discuss the evaluation criteria , and that's with Courtney .
Marketing: Okay , it's a PowerPoint presentation . I don't really know exactly what we should uh talk about . It's under evaluation .
Project Manager: Right .
Marketing: Alright . Um so these are the criteria we're gonna ask , is it easy to use , is it fashionable uh {disfmarker} yeah , I guess we should write these down so we can reference them .
Project Manager: Mm .
User Interface: Feel good meaning what ?
Marketing: Like does it feel good , like {disfmarker}
User Interface: Physically ,
Project Manager: Right .
User Interface: okay .
Marketing: yeah , physically .
User Interface: {gap}
Project Manager: Sqi {vocalsound}
Marketing: {vocalsound} {vocalsound} That's just for current trend .
Project Manager: Right .
User Interface: {vocalsound}
Marketing: It doesn't really count , you guys .
Industrial Designer: Yeah , it was a little difficult to incorporate the cover with the cherry fruit on it .
User Interface: {vocalsound}
Marketing: Yeah . But it's {disfmarker} so we do have removable covers , right ?
Project Manager: Right .
Industrial Designer: Yes .
User Interface: {gap}
Marketing: Yeah , well then that's covered .
Project Manager: 'Kay .
Marketing: And so we n k everybody have that ?
Project Manager: I'll wait .
Marketing: Yeah , she's got it .
User Interface: Yeah .
Marketing: It's good . Yeah . Okay so , we're using the criteria uh for a seven point scale , and so we need to discuss how we feel . It falls within this range , so for easy to use , do we feel it's very easy to use ?
Project Manager: Are we going to indi
User Interface: True or false , easy to use .
Project Manager: I say we individually rate {disfmarker} what do you say ?
Marketing: You guys {disfmarker}
Project Manager: Just orally .
User Interface: {vocalsound} Yeah .
Project Manager: Why not ? We have {disfmarker} okay .
Marketing: Okay .
Project Manager: Um easy to use . I vote six .
Marketing: Oh wait , that's false .
Project Manager: Oh ,
User Interface: {vocalsound}
Project Manager: two .
Marketing: Okay .
Industrial Designer: I'd say two as well .
User Interface: Yeah , two .
Marketing: Two . That's what I say .
Project Manager: Uh hello , we're great .
User Interface: {vocalsound}
Marketing: Okay , fashionable ?
Project Manager: {vocalsound} Um one .
Industrial Designer: At the moment , no .
Project Manager: No .
Marketing: No . I mean like no , I think it's very fashionable .
Project Manager: Me too , very chic . {vocalsound}
Marketing: I thi I would give it a one .
Project Manager: One , I give it a one .
Industrial Designer: Okay .
User Interface: {vocalsound}
Industrial Designer: I'll give it a two , because at the moment it's not looking that way .
Project Manager: Oh , and ma it's a prototype ,
Marketing: Well , that's that's just like {disfmarker} that's a clay , it's a prototype .
Project Manager: right .
User Interface: Mm I don't think it's that fashionable .
Marketing: What do you think ?
User Interface: I'd give it like three or four .
Project Manager: Well , now I'm {gap} .
Marketing: Okay .
Project Manager: So , the average is about a two .
User Interface: {vocalsound} But then I'm not fashionable , so
Marketing: Yeah , it's a two .
Project Manager: Two or three . Two point five .
User Interface: don't use my opinion .
Marketing: That's okay . Yeah .
Industrial Designer: Neither are all o all the customers we have , either .
Marketing: {vocalsound} Um
User Interface: {vocalsound}
Marketing: does it feel good ?
Project Manager: Imagine , since we obviously don't have that .
User Interface: Does it feel good ?
Marketing: I feel like {disfmarker}
Industrial Designer: Uh the shape of it actually does uh .
Project Manager: And it's i it is very ergonomically designed . It's gonna be curved .
User Interface: Yeah , it's gonna be thicker .
Project Manager: Yeah .
User Interface: Depth .
Marketing: I think it feels good .
Project Manager: I think so too .
Marketing: I'll give it a two .
Project Manager: 'Kay . Two .
User Interface: {vocalsound} I'll give it a one .
Marketing: What do you say ?
Industrial Designer: I'd say a two .
Project Manager: Alright , average is two .
Marketing: Okay .
Project Manager: Is it technologically innovative ? Oh sorry I'm taking over your job here .
User Interface: {vocalsound}
Marketing: Oh no , it's fine ,
Project Manager: Go right ahead . {vocalsound}
Marketing: you're {disfmarker} I mean you're Project Manager .
Industrial Designer: {vocalsound}
Marketing: Um yeah , I mean and it {disfmarker} does it have voice {disfmarker} I mean the phrase recognition on it ?
Project Manager: Yes . Right ? We were able to do it with that kind of chip .
User Interface: Oh right , the {disfmarker}
Industrial Designer: We could do it with the chip , yes . It wasn't {disfmarker} we have no reflection of it on the prototype ,
Marketing: And there's no way you can represent it on here . Y
Project Manager: Yeah , right .
Industrial Designer: but that's because it's only two dimensions , really .
Project Manager: That was {disfmarker} 'kay . And we discussed that being included .
User Interface: {vocalsound}
Marketing: {vocalsound} Yeah , so .
User Interface: Right .
Marketing: Then yes , then I would {disfmarker} well it isn't {disfmarker} what else would it need for it to be technologically innovative ?
Industrial Designer: It {disfmarker}
Project Manager: Well we don' have the {disfmarker} you know , we can't say channel , and it changes the channel , channel eight .
Marketing: And it doesn't cover anything other then T_V_ ,
Project Manager: Right .
Marketing: so I'd probably give it a three .
Industrial Designer: Yeah .
Project Manager: Okay .
Marketing: Even though it is {disfmarker} for just a T_V_ remote it's uh very advanced . But it is just a T_V_ remote .
Project Manager: Yeah . I'd go for a three or four on that one , so {disfmarker}
User Interface: Yeah I go four .
Project Manager: okay , let's go for a three point five .
User Interface: {vocalsound} {vocalsound}
Industrial Designer: Three and an half .
Project Manager: Alright , and the last criteria {disfmarker} is it is it um {disfmarker}
User Interface: Squishy and fruity .
Marketing: {vocalsound} Well yeah , so I'd give it a two .
Project Manager: Well , we've covered that with the
User Interface: It's just trendy , basically .
Project Manager: trendy . Sure . Capable . Very capable .
Industrial Designer: It's capable of being squishy and fruity .
Marketing: Oh , it's very capable of being squishy and fruity .
User Interface: {vocalsound} Okay .
Project Manager: And {vocalsound} it's very important . 'Kay , there we go .
Marketing: Yeah .
Project Manager: So .
Marketing: Okay , next .
Project Manager: Next . {vocalsound}
Marketing: {vocalsound} So um our re model slightly resembling a giant delicious cookie appears to be a winner ,
Project Manager: {vocalsound}
Industrial Designer: {vocalsound}
Marketing: and uh hopefully we'll sell millions . Good job , team . {vocalsound}
Industrial Designer: {vocalsound} How did you get that in there ?
User Interface: {vocalsound}
Marketing: {vocalsound} {vocalsound} What ?
Industrial Designer: The {vocalsound} slightly resembling a giant delicious cookie .
Project Manager: {vocalsound} It does .
User Interface: {vocalsound}
Marketing: It {vocalsound} it does . {vocalsound}
Industrial Designer: {vocalsound} That was good .
Project Manager: {vocalsound} Very good .
Marketing: Thanks .
Project Manager: Alright , let's go back to this {disfmarker} {vocalsound} No , that's it . Hmm . Oops . Okay , so now uh we're moving on to finance , okay . I'm gonna show you an Excel spreadsheet and we're going to fill it in together based on what components we're including in our remote and see if it's under twelve fifty Euro . If so , we can proceed , if not , we need to go back to the drawing board a little bit . 'Kay ? So let me bring that up . Here we go . Alright . Um it's not hand dynamo , it's powered by battery , so we give it a {disfmarker}
Industrial Designer: Yep .
Marketing: Two .
Project Manager: Number of components you plan to use . Do I just put quantity being one battery , or {disfmarker} Yeah .
Marketing: Yeah .
Industrial Designer: Mm 'kay .
Project Manager: But if it's a {disfmarker} do you wanna go for {disfmarker} this is where we need to make a final call on if it's a lithium or do we wanna go triple A_s , 'cause triple A_s we're gonna have t do more than one battery . Oh , let's just go for a lithium . What do you say ?
Industrial Designer: Yeah ,
User Interface: {vocalsound} {gap} {vocalsound}
Marketing: Yeah , let's let's do a lithium .
Project Manager: {vocalsound} I think uh I think the people who purchase this are gonna be technologically
Industrial Designer: it's {gap} .
Marketing: We're gon that's gon Nologically advanced ,
Project Manager: {disfmarker} right .
Marketing: yeah .
Project Manager: Okay , down to the electronics um section . We're gonna need this kind , correct , if we do the voice sensor ,
Industrial Designer: Yep .
Marketing: Yeah .
Project Manager: so one of those . It is a single-curved , so one of those .
Marketing: Uh {gap} .
Project Manager: Oh . What's that ? Yeah , that's correct .
Marketing: Yeah .
Project Manager: 'Kay , down here , case material .
User Interface: It's plastic .
Marketing: We {disfmarker}
Project Manager: Plastic .
Marketing: plastic .
User Interface: And special colour .
Marketing: And special colour .
Project Manager: 'Kay . {vocalsound} Down here , interface type . We're gonna have the integrated scroll scroll wheel .
User Interface: No , we don't have the scroll .
Project Manager: Isn't {disfmarker}
Industrial Designer: {vocalsound}
Project Manager: oh those are just regular buttons .
Industrial Designer: Well , that's the push-button too , right there .
User Interface: Buttons .
Marketing: But it's {disfmarker} Yeah ,
Project Manager: This ?
Marketing: but i so i
Industrial Designer: Integrated scroll-wheel or push-button .
User Interface: {vocalsound}
Industrial Designer: We're really having just push-button interface .
Project Manager: Okay , so we can just go {disfmarker} um .
Marketing: But will we w actually we'll need two , won't we ? One for the top and then one for the s one e for each side .
Industrial Designer: But it {disfmarker} that just covers the type of button we're having . Because we're not doing a scroll on the side , it's still push-button .
User Interface: Oh like the {disfmarker} twenty nine means like you have both scrolls and
Industrial Designer: Push-button .
Project Manager: Right I think she's {disfmarker}
Industrial Designer: But we just have push
User Interface: push-buttons .
Marketing: Okay .
User Interface: But we don't have any scrolls .
Project Manager: I think what Courtney's talking about is do we need to put two here ?
Marketing: Like because there's like one interface right here and then {disfmarker} because it's not gonna be on the same plane when you press the button .
Project Manager: Right .
Marketing: There's gonna have to be additional signals on the sides .
Industrial Designer: Yeah . Okay .
Marketing: So is that gonna be an extra one on each side ?
Project Manager: I don't know , they might put us {disfmarker} well , let's just .
User Interface: Two interfaces , is that what w should we s say ?
Project Manager: Two or would it be three ?
Industrial Designer: Let's call it th
Marketing: Or three , because of one on each side and one on top .
User Interface: Okay , fine . Yeah .
Marketing: I mean it's fine 'cause it comes out the same as twenty nine . Well less than twenty nine even .
Project Manager: Okay
Industrial Designer: Okay .
Project Manager: and we're gonna {disfmarker}
User Interface: {vocalsound}
Project Manager: button supplements {disfmarker} the buttons are no uh okay .
Marketing: They're a special colour . Um they're uh they're a special form , 'cause they're indented .
Project Manager: Are they ? Oh , right .
User Interface: And then s
Marketing: And , they're a special material .
User Interface: yeah .
Project Manager: Mm . Well , we're under cost then . Alright .
User Interface: We're over ?
Project Manager: No , we're under .
Industrial Designer: Grand .
Marketing: We're under .
Project Manager: Twelve point five is our limit .
User Interface: Okay .
Project Manager: We've got eleven point two .
User Interface: Oh , I see .
Project Manager: Alright .
Industrial Designer: So we can go to production .
Project Manager: We can go to {disfmarker} I dunno what I just did . {vocalsound} Okay . Now we're gonna talk about the project process um and whether or not we're satisfied with the whole process and the result . Um did we have a lot of room for creativity ? Did we have a lot of room for individual leadership , um teamwork , and the means , meaning the technology that we used to produce our little guy there , and if we found any new ideas . Now , question is , how do we do this ?
User Interface: {vocalsound}
Industrial Designer: Go back .
Marketing: {vocalsound} I think we just discuss it .
Project Manager: Discuss , sure .
Industrial Designer: Previous .
Project Manager: Alright . Who want who would like to go first ?
Industrial Designer: We think we got stifled for cri {vocalsound} creativity by the company itself , in restricting us only to using a T_V_ remote , initially .
User Interface: We didn't have a whiteboard .
Project Manager: Hmm . Hmm .
User Interface: Yeah .
Marketing: Oh that's true .
User Interface: And no internet .
Marketing: Yeah . {vocalsound} No , yeah , that's a good point . 'Cause I'd forgotten that that wasn't our decision , yeah .
Project Manager: {vocalsound} And how did you feel about the whole the whole process though ?
Marketing: Oh , overall I mean I thought we did a good job like {disfmarker}
User Interface: {vocalsound}
Marketing: We got to choose {disfmarker} basically we had control over {disfmarker} minus it being just merely a T_V_ remote we got to choose what we wanted to do with it .
Project Manager: Right , and we got say over what {disfmarker} how technologically advanced it should be and also how fashionable , which I kind of like {disfmarker}
Marketing: And we're a fashion forward technology company .
Project Manager: we {disfmarker} yep . You know it .
Industrial Designer: {gap} right .
Project Manager: Um what about um the teamwork aspect ? How did you guys enjoy making the model , the prototype ?
Marketing: {vocalsound}
Industrial Designer: {vocalsound} Yeah .
User Interface: I think we did well .
Project Manager: I think ya' did . Did you work well together in there , and {disfmarker}
User Interface: Yep . {vocalsound}
Project Manager: 'kay .
Industrial Designer: Well , no , there was there was scratching and fighting , but {disfmarker} no {vocalsound} .
Marketing: Minus that one fight .
User Interface: {vocalsound} Gouges .
Project Manager: Oh my God ,
Marketing: Yeah .
Project Manager: and we've all been a pretty congenial team here , I think .
Industrial Designer: {vocalsound}
Project Manager: We hadn't had any ma fallings out .
User Interface: {vocalsound}
Marketing: Yeah . I mean minus you guys being wha what is it , the survey , annoying or what is it ?
Project Manager: {vocalsound} Irritating .
Industrial Designer: Irritating . {vocalsound}
User Interface: Irritating .
Marketing: Irritating , yeah . Wow that's a {disfmarker} it's definitely a strong one .
Project Manager: Okay .
Industrial Designer: The means , the whiteboard didn't work . {vocalsound}
Project Manager: {vocalsound} Yeah .
User Interface: And no internet .
Marketing: Yeah .
Project Manager: I have to knock that one down a couple notches .
Industrial Designer: {vocalsound} A and our friend here really feels strongly about the internet . {vocalsound}
Marketing: Yeah , and no internet .
User Interface: Misses . I do .
Project Manager: {vocalsound}
User Interface: There's so much available .
Marketing: And the digital the digital pens
User Interface: Like it's information
Project Manager: Yeah , digital pens .
Industrial Designer: {vocalsound} I really appreciated those , yeah .
Marketing: were {disfmarker} they were pretty cool .
Project Manager: They were fine .
Marketing: Yeah they were fun , even though I'm not really sure what I could do with them , but they are awesome . {vocalsound}
Industrial Designer: The use of the laptops for receiving everything .
Project Manager: Right , laptops are extremely handy ,
Industrial Designer: It was wireless too , so .
Marketing: Yeah .
Project Manager: wireless . And that we have a shared network where we can put all of the {disfmarker}
Marketing: And these things whoa .
Industrial Designer: And let's not forget the sexy dual microphones everyone gets to wear .
User Interface: Yeah .
Marketing: Yeah . And Big Brother .
Project Manager: Big brother .
Marketing: {vocalsound} Yeah . {vocalsound}
Industrial Designer: {vocalsound}
Project Manager: 'Kay , have we found any new ideas through this process ?
Marketing: Um we are really gonna sell this .
Project Manager: {vocalsound}
Marketing: {vocalsound} Ta-da .
Project Manager: For something that looks cool and also has what I want it to b do technologically .
User Interface: Yeah .
Project Manager: And that's your right brain taking over , w wanting the artistic , the fashionable , the hip , you know .
Marketing: Mm-hmm .
Project Manager: If we all just went out and bought useful things , I don't think {disfmarker} I mean that's not what technology .
User Interface: Well , that's why I don't like uh Macs or Apples , just 'cause I look at it , and I know it's probably a very good computer , but I look at it , and I'm taken back to elementary school , 'cause they look the same .
Project Manager: Mm .
User Interface: They look like they did when I was in elementary school ,
Marketing: Yeah .
User Interface: and that's so old-fashioned to me .
Marketing: Yeah , 'cause they're pretty and just like {disfmarker}
Project Manager: Yeah .
Industrial Designer: The Toronto district school would only use his Macs with their kids .
User Interface: Exactly , so I associate them with like really low-tech , really cheap , bad {disfmarker}
Project Manager: Yeah . Just the Mac font bothers me even .
User Interface: Yeah .
Marketing: Uh yeah .
Project Manager: But I do like iPods , go figure .
Marketing: Yeah , no , iPods {vocalsound} {disfmarker} They want all those words for presentation , even the plugs .
Project Manager: Yeah .
Industrial Designer: Well , i iPods are now quite trendy ,
Project Manager: Mm-hmm .
Industrial Designer: and they come in different colours .
Project Manager: Colours . Exactly . I mean how many people went out and bough a Nokia phone , back when we were like in high school , just so they could get the changeable face plates .
Industrial Designer: Yeah .
User Interface: {vocalsound}
Marketing: Oh yeah , everybody .
Project Manager: Okay .
User Interface: {vocalsound}
Project Manager: Anyway , so that is definitely at work .
Industrial Designer: Not me .
Marketing: {vocalsound} Mine is amber .
Industrial Designer: {vocalsound} I didn't have a phone 'til university .
User Interface: But the {disfmarker} my {disfmarker} but my one issue is just like the whole it's for T_V_ only .
Marketing: Oh .
User Interface: I was like who's gonna buy a remote just for the T_V_ unless they've lost theirs .
Project Manager: Yeah .
Marketing: Look at it . {vocalsound}
Project Manager: {vocalsound} Fashionable chic people will .
User Interface: You're kidding .
Marketing: That is a piece of work .
User Interface: No , no .
Marketing: {vocalsound} Wow . Marketing Director says yeah .
User Interface: {vocalsound} No , marketing has to actually create the desire for it . {vocalsound}
Marketing: Fashionable people will buy it . Oh , I will create desire . {vocalsound}
Industrial Designer: That's okay . We can create a commercial where they think that all their needs will be met . This will help them find the one .
User Interface: Ri {vocalsound} They'll be sexy with it . {vocalsound}
Project Manager: Hmm .
Industrial Designer: That's right .
Marketing: We could have like an Adam and Eve type commercial , and that's the fig-leaf .
Project Manager: {vocalsound}
Industrial Designer: {vocalsound}
User Interface: Oh right .
Marketing: Mm . {vocalsound} That'll sell .
Industrial Designer: {vocalsound} And so the serpent says , use our remote . {vocalsound}
Project Manager: There you go , marketing {gap} .
User Interface: Let you loose .
Project Manager: {vocalsound} Alright .
Marketing: Yeah .
User Interface: Yeah , no .
Marketing: Yeah . {vocalsound}
Project Manager: {vocalsound} Okay , we're gonna wrap this up now . Um the costs are within the budget , we evaluated the project ,
User Interface: {vocalsound}
Project Manager: and now we're gonna complete the final questionnaire and meeting summary , and then we're going to have a big giant party , apparently , according to this , so . Alright , thank you team ,
Industrial Designer: Whoohoo . Margaritas for everyone . {vocalsound}
Project Manager: you did a great job , it was lovely working with you .
User Interface: {vocalsound} Good .
Marketing: You too .
Industrial Designer: Yay . Thanks to the Project Leader .
Project Manager: {vocalsound}
Industrial Designer: Now we know w


Professor E: Let 's see . Test ? Test ? Yeah . OK .
Grad A: Hello ?
PhD B: Channel one .
Grad A: Hello ?
PhD C: Test .
Professor E: I was saying Hynek 'll be here next week , uh , Wednesday through Friday {disfmarker} uh , through Saturday , and , um , I won't be here Thursday and Friday . But my suggestion is that , uh , at least for this meeting , people should go ahead , uh , cuz Hynek will be here , and , you know , we don't have any Czech accent yet , uh , {vocalsound} as far as I know , so {disfmarker} There we go .
PhD F: OK .
Professor E: Um . So other than reading digits , what 's our agenda ?
PhD F: I don't really have , uh , anything new . Been working on {pause} Meeting Recorder stuff . So .
Professor E: OK . Um . Do you think that would be the case for next week also ? Or is {disfmarker} is , uh {disfmarker} ? What 's your projection on {disfmarker} ?
PhD F: Um .
Professor E: Cuz the one thing {disfmarker} the one thing that seems to me we really should try , if you hadn't tried it before , because it hadn't occurred to me {disfmarker} it was sort of an obvious thing {disfmarker} is , um , adjusting the , uh , sca the scaling and , uh , insertion penalty sorta stuff .
PhD F: I did play with that , actually , a little bit . Um . What happens is , uh , {vocalsound} when you get to the noisy stuff , you start getting lots of insertions .
Professor E: Right .
PhD F: And , um , so I 've tried playing around a little bit with , um , the insertion penalties and things like that .
Professor E: Yeah .
PhD F: Um . I mean , it {disfmarker} it didn't make a whole lot of difference . Like for the well - matched case , it seemed like it was pretty good . Um . {vocalsound} I could do more playing with that , though . And , uh {disfmarker}
Professor E: But you were looking at mel cepstrum .
PhD F: and see . Yes .
Professor E: Right .
PhD F: Oh , you 're talking about for th {vocalsound} for our features .
Professor E: Right . So , I mean , i it it 's not the direction that you were working with that we were saying what 's the {disfmarker} uh , what 's the best you can do with {disfmarker} with mel cepstrum . But , they raised a very valid point ,
PhD F: Mmm .
Professor E: which , I guess {disfmarker} So , to first order {disfmarker} I mean , you have other things you were gonna do , but to first order , I would say that the conclusion is that if you , um , do , uh , some monkeying around with , uh , the exact HTK training and @ @ {comment} with , uh , you know , how many states and so forth , that it {disfmarker} it doesn't particularly improve the performance . In other words , that even though it sounds pretty dumb , just applying the same number of states to everything , more or less , no matter what language , isn't so bad . Right ? And I guess you hadn't gotten to all the experiments you wanted to do with number of Gaussians ,
PhD F: Right .
Professor E: but , um , let 's just {disfmarker} If we had to {disfmarker} if we had to draw a conclusion on the information we have so far , we 'd say something like that . Right ?
PhD F: Mm - hmm .
Professor E: Uh , so the next question to ask , which is I think the one that {disfmarker} that {disfmarker} that Andreas was dre addressing himself to in the lunch meeting , is , um , we 're not supposed to adjust the back - end , but anybody using the system would .
PhD F: Yeah .
Professor E: So , if you were just adjusting the back - end , how much better would you do , uh , in noise ? Uh , because the language scaling and insertion penalties and so forth are probably set to be about right for mel cepstrum .
PhD F: Mm - hmm .
Professor E: But , um , they 're probably not at all set right for these things , particularly these things that look over , uh , larger time windows , in one way or another with {disfmarker} with LDA and KLT and neural nets and {vocalsound} all these things . In the fa past we 've always found that we had to increase the insertion penalty to {disfmarker} to correspond to such things . So , I think that 's , uh , @ @ {comment} that 's kind of a first - order thing that {disfmarker} that we should try .
PhD F: So for th so the experiment is to , um , run our front - end like normal , with the default , uh , insertion penalties and so forth , and then tweak that a little bit and see how much of a difference it makes
Professor E: So by " our front - end " I mean take , you know , the Aurora - two s take some version that Stephane has that is , you know , our current best version of something .
PhD F: if we were {disfmarker} Mm - hmm .
Professor E: Um . I mean , y don't wanna do this over a hundred different things that they 've tried but , you know , for some version that you say is a good one . You know ? Um . How {disfmarker} how much , uh , does it improve if you actually adjust that ?
PhD F: OK .
Professor E: But it is interesting . You say you {disfmarker} you have for the noisy {disfmarker} How about for the {disfmarker} for the mismatched or {disfmarker} or {disfmarker} or {disfmarker} or the {disfmarker} or the medium mismatched conditions ? Have you {disfmarker} ? When you adjusted those numbers for mel cepstrum , did it {disfmarker} ?
PhD F: Uh , I {disfmarker} I don't remember off the top of my head . Um . Yeah . I didn't even write them down . I {disfmarker} I {disfmarker} I don't remember . I would need to {disfmarker} Well , I did write down , um {disfmarker} So , when I was doing {disfmarker} I just wrote down some numbers for the well - matched case .
Professor E: Yeah .
PhD F: Um . Looking at the {disfmarker} I wrote down what the deletions , substitutions , and insertions were , uh , for different numbers of states per phone .
Professor E: Yeah .
PhD F: Um , but , uh , that {disfmarker} that 's all I wrote down .
Professor E: OK .
PhD F: So . I {disfmarker} I would {disfmarker} Yeah . I would need to do that .
Professor E: OK . So {disfmarker}
PhD F: I can do that for next week .
Professor E: Yeah . And , um {disfmarker} Yeah . Also , eh , eh , sometimes if you run behind on some of these things , maybe we can get someone else to do it and you can supervise or something . But {disfmarker} but I think it would be {disfmarker} it 'd be good to know that .
PhD F: OK . I just need to get , um , {vocalsound} front - end , uh , stuff from you
PhD B: Hmm .
PhD F: or you point me to some files {pause} that you 've already calculated .
PhD B: Yeah . Alright .
Professor E: OK . Uh .
PhD F: I probably will have time to do that and time to play a little bit with the silence model .
Professor E: Mm - hmm .
PhD F: So maybe I can have that for next week when Hynek 's here .
Professor E: Yeah .
PhD B: Mm - hmm .
Professor E: Yeah . Cuz , I mean , the {disfmarker} the other {disfmarker} That , in fact , might have been part of what , uh , the difference was {disfmarker} at least part of it that {disfmarker} that we were seeing . Remember we were seeing the SRI system was so much better than the tandem system .
PhD F: Hmm .
Professor E: Part of it might just be that the SRI system , they {disfmarker} they {disfmarker} they always adjust these things to be sort of optimized ,
PhD F: Is there {disfmarker} ?
Professor E: and {disfmarker}
PhD F: I wonder if there 's anything that we could do {vocalsound} to the front - end that would affect the insertion {disfmarker}
Professor E: Yes . I think you can .
PhD F: What could you do ?
Professor E: Well , um {disfmarker} uh , part of what 's going on , um , is the , uh , the range of values . So , if you have something that has a much smaller range or a much larger range , and taking the appropriate root .
PhD F: Oh . Mm - hmm .
Professor E: You know ? If something is kind of like the equivalent of a bunch of probabilities multiplied together , you can take a root of some sort . If it 's like seven probabilities together , you can take the seventh root of it or something , or if it 's in the log domain , divide it by seven .
PhD F: Mm - hmm .
Professor E: But {disfmarker} but , um , that has a similar effect because it changes the scale of the numbers {disfmarker} of the differences between different candidates from the acoustic model
PhD F: Oh , right .
Professor E: as opposed to what 's coming from the language model .
PhD F: So that w Right . So , in effect , that 's changing the value of your insertion penalty .
Professor E: Yeah . I mean , it 's more directly like the {disfmarker} the language scaling or the , uh {disfmarker} the model scaling or acoustic scaling ,
PhD F: That 's interesting .
Professor E: but you know that those things have kind of a similar effect to the insertion penalty
PhD F: Mm - hmm .
Professor E: anyway . They 're a slightly different way of {disfmarker} of handling it .
PhD F: Right .
Professor E: So , um {disfmarker}
PhD F: So if we know what the insertion penalty is , then we can get an idea about what range our number should be in ,
Professor E: I think so .
PhD F: so that they {pause} match with that .
Professor E: Yeah . Yeah . So that 's why I think that 's another reason other than curiosity as to why i it would in fact be kinda neat to find out if we 're way off . I mean , the other thing is , are aren't we seeing {disfmarker} ? Y y
PhD F: Mm - hmm .
Professor E: I 'm sure you 've already looked at this bu in these noisy cases , are {disfmarker} ? We are seeing lots of insertions . Right ? The insertion number is quite high ?
PhD B: Yeah .
Professor E: I know the VAD takes pre care of part of that ,
PhD F: Yeah .
PhD B: Yeah .
Professor E: but {disfmarker}
PhD F: I 've seen that with the mel cepstrum . I don't {disfmarker} I don't know about {pause} the Aurora front - end , but {disfmarker}
PhD B: I think it 's much more balanced with , uh {disfmarker} when the front - end is more robust . Yeah . I could look at it {disfmarker} at this . Yeah . Mm - hmm .
Professor E: Yeah . Wha - what 's a typical number ?
PhD B: I don't {disfmarker} I don't know .
Professor E: Do we {disfmarker} ? Oh , you {disfmarker} oh , you don't know .
PhD B: I don't have this in {disfmarker}
Professor E: OK . I 'm sure it 's more balanced ,
PhD B: Mm - hmm .
Professor E: but it {disfmarker} it {disfmarker} it wouldn't surprise me if there 's still {disfmarker}
PhD B: Mm - hmm .
Professor E: I mean , in {disfmarker} in the {disfmarker} the {disfmarker} the old systems we used to do , I {disfmarker} I {disfmarker} uh , I remember numbers kind of like insertions being half the number of deletions , as being {disfmarker} and both numbers being {disfmarker} tend to be on the small side comparing to {disfmarker} to , uh , substitutions .
PhD B: Mm - hmm .
PhD F: Well , this {disfmarker} the whole problem with insertions was what I think , um , we talked about when the guy from OGI came down {pause} that one time and {disfmarker} and that was when people were saying , well we should have a , uh , uh , voice activity detector {disfmarker}
Professor E: Right .
PhD F: that , because all that stuff {comment} that we 're getting thr the silence that 's getting through is causing insertions . So .
PhD B: Mmm .
Professor E: Right .
PhD F: I 'll bet you there 's still a lot {vocalsound} of insertions .
PhD B: Mm - hmm .
Professor E: Yeah . And it may be less of a critical thing . I mean , the fact that some get by may be less of a critical thing if you , uh , get things in the right range .
PhD F: Mm - hmm .
Professor E: So , I mean , the insertions is {disfmarker} is a symptom . It 's a symptom that there 's something , uh , wrong with the range .
PhD F: Right .
Professor E: But there 's {disfmarker} uh , your {disfmarker} your {disfmarker} your substitutions tend to go up as well . So , uh , I {disfmarker} I {disfmarker} I think that ,
PhD F: Mm - hmm .
Professor E: uh , the most obvious thing is just the insertions , @ @ . But {disfmarker} Uh {disfmarker} um . If you 're operating in the wrong range {disfmarker} I mean , that 's why just in general , if you {vocalsound} change what these {disfmarker} these penalties and scaling factors are , you reach some point that 's a {disfmarker} that 's a minimum . So . Um . Um . We do have to do well over a range of different conditions , some of which are noisier than others . Um . But , um , I think we may get a better handle on that if we {disfmarker} if we see {disfmarker} Um , I mean we ca it 's if we actually could pick a {disfmarker} a {disfmarker} a more stable value for the range of these features , it , um , uh , could {disfmarker} Uh {disfmarker} Even though it 's {disfmarker} it 's {disfmarker} it 's true that in a real situation you can in fact adjust the {disfmarker} these {disfmarker} these scaling factors in the back - end , and it 's ar artificial here that we 're not adjusting those , you certainly don't wanna be adjusting those all the time . And if you have a nice front - end that 's in roughly the right range {disfmarker}
PhD F: Hmm .
Professor E: I remember after we got our stuff more or less together in the previous systems we built , that we tended to set those scaling factors at kind of a standard level , and we would rarely adjust them again , even though you could get a {disfmarker}
PhD F: Mm - hmm .
Professor E: for an evaluation you can get an extra point or something if you tweaked it a little bit . But , once we knew what rou roughly the right operating range was , it was pretty stable , and {disfmarker} Uh , we might just not even be in the right operating range .
PhD F: So , would the {disfmarker} ? Uh , would a good idea be to try to map it into the same range that you get in the well - matched case ? So , if we computed what the range was in well - matched , and then when we get our noisy conditions out we try to make it have the same range as {disfmarker} ?
Professor E: No . You don't wanna change it for different conditions . No . No . I {disfmarker} I {disfmarker} I {disfmarker} What {disfmarker} what I 'm saying {disfmarker}
PhD F: Oh , I wasn't suggesting change it for different conditions . I was just saying that when we pick a range , we {disfmarker} we wanna pick a range that we map our numbers into {disfmarker}
Professor E: Yeah .
PhD F: we should probably pick it based on the range that we get in the well - matched case . Otherwise , I mean , what range are we gonna choose to {disfmarker} to map everything into ?
Professor E: Well . It depends how much we wanna do gamesmanship and how much we wanna do {disfmarker} I mean , i if he it {disfmarker} to me , actually , even if you wanna be {disfmarker} play on the gamesmanship side , it can be kinda tricky . So , I mean , what you would do is set the {disfmarker} set the scaling factors , uh , so that you got the best number for this point four five times the {disfmarker} {vocalsound} you know , and so on .
PhD F: Mm - hmm .
Professor E: But they might change that {disfmarker} those weightings .
PhD F: Yeah .
Professor E: Um . So {disfmarker} Uh {disfmarker} I just sorta think we need to explore the space . Just take a look at it a little bit .
PhD F: Mm - hmm .
Professor E: And we {disfmarker} we {disfmarker} we may just find that {disfmarker} that we 're way off .
PhD F: OK . Mm - hmm .
Professor E: Maybe we 're not . You know ? As for these other things , it may turn out that , uh , {vocalsound} it 's kind of reasonable . But then {disfmarker} I mean , Andreas gave a very reasonable response , and he 's probably not gonna be the only one who 's gonna say this in the future {disfmarker} of , you know , people {disfmarker} people within this tight - knit community who are doing this evaluation {vocalsound} are accepting , uh , more or less , that these are the rules . But , people outside of it who look in at the broader picture are certainly gonna say " Well , wait a minute . You 're doing all this standing on your head , uh , on the front - end ,
PhD F: Yeah .
Professor E: when all you could do is just adjust this in the back - end with one s one knob . "
PhD F: Mm - hmm .
Professor E: And so we have to at least , I think , determine that that 's not true , which would be OK , or determine that it is true , in which case we want to adjust that and then continue with {disfmarker} with what we 're doing . And as you say {disfmarker} as you point out {disfmarker} finding ways to then compensate for that in the front - end {vocalsound} also then becomes a priority for this particular test ,
PhD F: Right .
Professor E: and saying you don't have to do that .
PhD F: Mm - hmm .
Professor E: So . OK . So , uh {disfmarker} What 's new with you ?
PhD B: Uh . So there 's nothing {pause} new . Um .
Professor E: Uh , what 's old with you that 's developed ?
PhD B: I 'm sorry ?
Professor E: You {disfmarker} OK . What 's old with you that has developed over the last week or two ?
PhD B: Mmm . Well , so we 've been mainly working on the report and {disfmarker} and {disfmarker} Yeah .
PhD F: Mainly working on what ?
PhD B: On the report {pause} of the work that was already done .
PhD F: Oh .
PhD B: Um . Mm - hmm . That 's all .
PhD F: How about that {disfmarker} ? Any - anything new on the thing that , uh , you were working on with the , uh {disfmarker} ?
PhD C: I don't have results yet .
PhD F: No results ? Yeah .
Professor E: What was that ?
PhD F: The {disfmarker} the , uh ,
Grad A: Voicing thing .
PhD F: voicing detector .
Professor E: I mean , what what 's {disfmarker} what 's going on now ? What are you {pause} doing ?
PhD C: Uh , to try to found , nnn , robust feature for detect between voice and unvoice . And we {disfmarker} w we try to use {vocalsound} the variance {vocalsound} of the es difference between the FFT spectrum and mel filter bank spectrum .
Professor E: Yeah .
PhD C: Uh , also the {disfmarker} another parameter is {disfmarker} relates with the auto - correlation function .
Professor E: Uh - huh .
PhD C: R - ze energy and the variance a also of the auto - correlation function .
Professor E: Uh - huh . So , that 's {disfmarker} Yeah . That 's what you were describing , I guess , a week or two ago .
PhD C: Yeah . But we don't have res we don't have result of the AURO for Aurora yet .
Professor E: So .
PhD C: We need to train the neural network
Professor E: Mm - hmm .
PhD C: and {disfmarker}
Professor E: So you 're training neural networks now ?
PhD C: No , not yet .
Professor E: So , what {disfmarker} wha {vocalsound} wh wha what what 's going on ?
PhD C: Well , we work in the report , too , because we have a lot of result ,
Professor E: Uh - huh .
PhD C: they are very dispersed , and was necessary to {disfmarker} to look in all the directory to {disfmarker} to {disfmarker} to give some more structure .
PhD B: Yea
Professor E: So . B So {disfmarker} Yeah . I if I can summarize , basically what 's going on is that you 're going over a lot of material that you have generated in furious fashion , f generating many results and doing many experiments and trying to pull it together into some coherent form to be able to see wha see what happens .
PhD C: Hm - hmm .
PhD B: Uh , y yeah . Basically we we 've stopped , uh , experimenting ,
Professor E: Yes ?
PhD B: I mean . We 're just writing some kind of technical report . And {disfmarker}
PhD F: Is this a report that 's for Aurora ? Or is it just like a tech report for ICSI ,
PhD C: No .
PhD B: Yeah .
PhD C: For ICSI .
PhD F: or {disfmarker} ? Ah . I see .
PhD B: Yeah .
PhD C: Just summary of the experiment and the conclusion and something like that .
Professor E: Yeah .
PhD B: Mm - hmm .
Professor E: OK . So , my suggestion , though , is that you {disfmarker} you not necessarily finish that . But that you put it all together so that it 's {disfmarker} you 've got {disfmarker} you 've got a clearer structure to it . You know what things are , you have things documented , you 've looked things up that you needed to look up .
PhD B: Mm - hmm .
Professor E: So that , you know {disfmarker} so that such a thing can be written . And , um {disfmarker} When {disfmarker} when {disfmarker} when do you leave again ?
PhD C: Uh , in July . First of July .
Professor E: First of July ? OK . And that you figure on actually finishing it in {disfmarker} in June . Because , you know , you 're gonna have another bunch of results to fit in there anyway .
PhD B: Mm - hmm .
PhD C: Mm - hmm .
Professor E: And right now it 's kind of important that we actually go forward with experiments .
PhD C: It 's not .
Professor E: So {disfmarker} so , I {disfmarker} I think it 's good to pause , and to gather everything together and make sure it 's in good shape , so that other people can get access to it and so that it can go into a report in June . But I think {vocalsound} to {disfmarker} to really work on {disfmarker} on fine - tuning the report n at this point is {disfmarker} is probably bad timing , I {disfmarker} I {pause} think .
PhD B: Mm - hmm . Yeah . Well , we didn't {disfmarker} we just planned to work on it one week on this report , not {disfmarker} no more , anyway . Um .
Professor E: But you ma you may really wanna add other things later anyway
PhD B: Yeah . Mm - hmm .
Professor E: because you {disfmarker}
PhD B: Mmm .
Professor E: There 's more to go ?
PhD B: Yeah . Well , so I don't know . There are small things that we started to {disfmarker} to do . But {disfmarker}
PhD F: Are you discovering anything , uh , that makes you scratch your head as you write this report , like why did we do that , or why didn't we do this ,
PhD B: Uh .
PhD F: or {disfmarker} ?
PhD B: Yeah . Yeah . And {disfmarker} Actually , there were some tables that were also with partial results . We just noticed that , wh while gathering the result that for some conditions we didn't have everything .
PhD F: Mmm .
PhD B: But anyway . Um . Yeah , yeah . We have , yeah , extracted actually the noises from {pause} the SpeechDat - Car . And so , we can train neural network with speech and these noises . Um . It 's difficult to say what it will give , because when we look at the Aurora {disfmarker} the TI - digits experiments , um , they have these three conditions that have different noises , and apparently this system perform as well on the seen noises {disfmarker} on the unseen noises and on the seen noises . But , I think this is something we have to try anyway . So {disfmarker} adding the noises from {disfmarker} from the SpeechDat - Car . Um .
Professor E: That 's {disfmarker} that 's , uh {disfmarker} that 's permitted ?
PhD B: Uh . Well , OGI does {disfmarker} did that . Um . At some point they did that for {disfmarker} for the voice activity detector .
PhD C: Uh , for a v VAD .
PhD B: Right ? Um .
PhD F: Could you say it again ? What {disfmarker} what exactly did they do ?
PhD B: They used some parts of the , um , Italian database to train the voice activity detector , I think . It {disfmarker}
Professor E: Yeah . I guess the thing is {disfmarker} Yeah . I guess that 's a matter of interpretation . The rules as I understand it , is that in principle the Italian and the Spanish and the English {disfmarker} no , Italian and the Finnish and the English ? {disfmarker} were development data
PhD B: Yeah . And Spanish , yeah .
Professor E: on which you could adjust things . And the {disfmarker} and the German and Danish were the evaluation data .
PhD B: Mm - hmm .
Professor E: And then when they finally actually evaluated things they used everything .
PhD B: Yeah . That 's right . Uh {disfmarker}
Professor E: So {disfmarker} Uh , and it is true that the performance , uh , on the German was {disfmarker} I mean , even though the improvement wasn't so good , the pre the raw performance was really pretty good .
PhD B: Mm - hmm .
Professor E: So {disfmarker} And , uh , it {disfmarker} it doesn't appear that there 's strong evidence that even though things were somewhat tuned on those three or four languages , that {disfmarker} that going to a different language really hurt you . And the noises were not exactly the same . Right ? Because it was taken from a different , uh {disfmarker} I mean they were different drives .
PhD B: Different cars . Yeah .
Professor E: I mean , it was {disfmarker} it was actual different cars and so on .
PhD B: Yeah .
Professor E: So . Um , it 's somewhat tuned . It 's tuned more than , you know , a {disfmarker} a {disfmarker} a {disfmarker} a {disfmarker}
PhD B: Mm - hmm .
Professor E: You 'd really like to have something that needed no particular noise at all , maybe just some white noise or something like that a at most .
PhD B: Mm - hmm .
Professor E: But that 's not really what this contest is . So . Um , I guess it 's OK .
PhD B: Mm - hmm .
Professor E: That 's something I 'd like to understand before we actually use something from it ,
PhD F: I think it 's {disfmarker}
Professor E: because it would {disfmarker}
PhD F: it 's probably something that , mmm , the {disfmarker} you know , the , uh , experiment designers didn't really think about , because I think most people aren't doing trained systems , or , you know , uh , systems that are like ours , where you actually use the data to build models . I mean , they just {pause} doing signal - processing .
PhD B: Yeah .
Professor E: Well , it 's true ,
PhD F: So .
Professor E: except that , uh , that 's what we used in Aurora one , and then they designed the things for Aurora - two knowing that we were doing that .
PhD F: Yeah . That 's true .
Professor E: Um .
PhD F: And they didn't forbid us {disfmarker} right ? {disfmarker} to build models on the data ?
Professor E: No . But , I think {disfmarker} I think that it {disfmarker} it {disfmarker} it probably would be the case that if , say , we trained on Italian , uh , data and then , uh , we tested on Danish data and it did terribly , uh , that {disfmarker} that it would look bad . And I think someone would notice and would say " Well , look . This is not generalizing . " I would hope tha I would hope they would .
PhD F: Mm - hmm .
Professor E: Um . But , uh , it 's true . You know , maybe there 's parameters that other people have used {disfmarker} you know , th that they have tuned in some way for other things . So it 's {disfmarker} it 's , uh {disfmarker} We should {disfmarker} we should {disfmarker} Maybe {disfmarker} that 's maybe a topic {disfmarker} Especially if you talk with him when I 'm not here , that 's a topic you should discuss with Hynek
PhD B: Mm - hmm .
Professor E: to , you know , double check it 's OK .
PhD F: Do we know anything about {pause} the speakers for each of the , uh , training utterances ?
PhD B: What do you mean ? We {disfmarker} we {disfmarker}
PhD F: Do you have speaker information ?
Professor E: Social security number
PhD F: That would be good .
PhD B: Like , we have {pause} male , female ,
PhD C: Hmm .
PhD F: Bank PIN .
PhD B: at least .
PhD F: Just male f female ?
PhD B: Mmm .
Professor E: What kind of information do you mean ?
PhD F: Well , I was thinking about things like , you know , gender , uh {disfmarker} you know , gender - specific nets and , uh , vocal tract length normalization .
PhD B: Mm - hmm .
PhD F: Things like that . I d I don't {disfmarker} I didn't know what information we have about the speakers that we could try to take advantage of .
PhD B: Mm - hmm .
Professor E: Hmm . Uh . Right . I mean , again , i if you had the whole system you were optimizing , that would be easy to see . But if you 're {vocalsound} supposedly just using a fixed back - end and you 're just coming up with a feature vector , w w I 'm not sure {disfmarker} I mean , having the two nets {disfmarker} Suppose you detected that it was male , it was female {disfmarker} you come up with different {disfmarker}
PhD F: Well , you could put them both in as separate streams or something . Uh .
PhD B: Mm - hmm .
Professor E: Maybe .
PhD F: I don't know . I was just wondering if there was other information we could exploit .
PhD B: Mm - hmm .
Professor E: Hmm . Yeah , it 's an interesting thought . Maybe having something along the {disfmarker} I mean , you can't really do vocal tract normalization . But something that had some of that effect
PhD F: Yeah .
Professor E: being applied to the data in some way .
PhD F: Mm - hmm .
Professor E: Um .
PhD B: Do you have something simple in mind for {disfmarker} I mean , vocal tract length normalization ?
PhD F: Uh no . I hadn't {disfmarker} I hadn't thought {disfmarker} it was {disfmarker} thought too much about it , really . It just {disfmarker} something that popped into my head just now . And so I {disfmarker} I {disfmarker} I mean , you could maybe use the ideas {disfmarker} a similar {pause} idea to what they do in vocal tract length normalization . You know , you have some sort of a , uh , general speech model , you know , maybe just a mixture of Gaussians that you evaluate every utterance against , and then you see where each , you know , utterance {disfmarker} like , the likelihood of each utterance . You divide the {disfmarker} the range of the likelihoods up into discrete bins and then each bin 's got some knob {disfmarker} uh , setting .
Professor E: Yeah . But just listen to yourself . I mean , that uh really doesn't sound like a real - time thing with less than two hundred milliseconds , uh , latency that {disfmarker} and where you 're not adjusting the statistical engine at all .
PhD F: Yeah . Yeah .
PhD B: Mm - hmm .
PhD F: Yeah . That 's true .
Professor E: You know , that just {disfmarker}
PhD F: Right .
PhD B: Hmm .
Professor E: I mean {disfmarker} Yeah .
PhD F: Could be expensive .
Professor E: No . Well not just expensive . I {disfmarker} I {disfmarker} I don't see how you could possibly do it . You can't look at the whole utterance and do anything . You know , you can only {disfmarker} Right ?
PhD F: Oh ,
Professor E: Each frame comes in and it 's gotta go out the other end .
PhD F: right .
Professor E: So , uh {disfmarker}
PhD F: Right . So whatever it was , it would have to be uh sort of on a per frame basis .
Professor E: Yeah .
PhD B: Mm - hmm .
Professor E: Yeah . I mean , you can do , um {disfmarker} Fairly quickly you can do male female {disfmarker} f male female stuff .
PhD F: Yeah . Yeah .
Professor E: But as far as , I mean {disfmarker} Like I thought BBN did a thing with , uh , uh , vocal tract normalization a ways back . Maybe other people did too . With {disfmarker} with , uh , uh , l trying to identify third formant {disfmarker} average third formant {disfmarker} {vocalsound} using that as an indicator of {disfmarker}
PhD F: I don't know .
Professor E: So . You know , third formant {disfmarker} I if you imagine that to first order what happens with , uh , changing vocal tract is that , uh , the formants get moved out by some proportion {disfmarker}
PhD F: Mm - hmm .
Professor E: So , if you had a first formant that was one hundred hertz before , if the fifty {disfmarker} if the vocal tract is fifty percent shorter , then it would be out at seven fifty hertz , and so on . So , that 's a move of two hundred fifty hertz . Whereas the third formant which might have started off at twenty - five hundred hertz , you know , might be out to thirty - seven fifty , you know so it 's at {disfmarker} So , although , you frequently get less distinct higher formants , it 's still {disfmarker} third formant 's kind of a reasonable compromise , and {disfmarker}
PhD F: Mm - hmm .
Professor E: So , I think , eh , if I recall correctly , they did something like that . And {disfmarker} and {disfmarker}
PhD F: Hmm .
Professor E: But {disfmarker} Um , that doesn't work for just having one frame or something .
PhD F: Yeah .
PhD B: Mm - hmm .
Professor E: You know ? That 's more like looking at third formant over {disfmarker} over a turn or something like that ,
PhD B: Mm - hmm .
Professor E: and {disfmarker}
PhD F: Right .
Professor E: Um . So . But on the other hand , male female is a {disfmarker} is a {disfmarker} is a much simpler categorization than figuring out a {disfmarker} a factor to , uh , squish or expand the {disfmarker} the spectrum .
PhD F: Mm - hmm .
Professor E: So , um . Y you could imagine that {disfmarker} I mean , just like we 're saying voiced - unvoiced is good to know {disfmarker} uh , male female is good to know also . Um .
PhD F: Mm - hmm .
Professor E: But , you 'd have to figure out a way to {disfmarker} to {disfmarker} to , uh , incorporate it on the fly . Uh , I mean , I guess , as you say , one thing you could do is simply , uh , have the {disfmarker} the male and female output vectors {disfmarker} you know , tr nets trained only on males and n trained only on females or {disfmarker} or , uh , you know . But {disfmarker} Um . I don't know if that would really help , because you already have males and females and it 's mm - hmm putting into one net . So is it {disfmarker} ?
PhD F: Is it balanced , um , in terms of gender {disfmarker} the data ?
PhD B: Mmm .
Professor E: Do you know ?
PhD B: Almost , yeah .
PhD F: Hmm .
PhD B: Mm - hmm .
Professor E: Hmm . OK . Y you 're {disfmarker} you were saying before {disfmarker} ?
PhD B: Uh . Yeah . So , this noise , um {disfmarker} Yeah . The MSG {disfmarker} Um . Mmm . There is something {disfmarker} perhaps , I could spend some days to look at this thing , cuz it seems that when we train networks on {disfmarker} let 's say , on TIMIT with MSG features , they {disfmarker} they look as good as networks trained on PLP . But , um , when they are used on {disfmarker} on the SpeechDat - Car data , it 's not the case {disfmarker} oh , well . The MSG features are much worse , and so maybe they 're , um , less {disfmarker} more sensitive to different recording conditions , or {disfmarker} Shou
Professor E: Shouldn't be . They should be less so .
PhD B: Yeah . But {disfmarker}
Professor E: R right ?
PhD B: Mmm .
Professor E: Wh - ? But let me ask you this . What {disfmarker} what 's the , um {disfmarker} ? Do you kno recall if the insertions were {disfmarker} were higher with MSG ?
PhD B: I don't know . I cannot tell . But {disfmarker} It 's {disfmarker} it {disfmarker} the {disfmarker} the error rate is higher . So , I don
Professor E: Yeah . But you should always look at insertions , deletions , and substitutions .
PhD B: Yeah . Mm - hmm .
Professor E: So {disfmarker}
PhD B: Mm - hmm .
Professor E: so , uh {disfmarker} MSG is very , very dif Eh , PLP is very much like mel cepstrum . MSG is very different from both of them .
PhD B: Mm - hmm .
Professor E: So , if it 's very different , then this is the sort of thing {disfmarker} I mean I 'm really glad Andreas brought this point up . I {pause} sort of had forgotten to discuss it . Um . You always have to look at how this {disfmarker} uh , these adjustments , uh , affect things . And even though we 're not allowed to do that , again we maybe could reflect that back to our use of the features .
PhD B: Mm - hmm .
Professor E: So if it {disfmarker} if in fact , uh {disfmarker} The problem might be that the range of the MSG features is quite different than the range of the PLP or mel cepstrum .
PhD B: Mm - hmm . Mm - hmm .
Professor E: And you might wanna change that .
PhD B: But {disfmarker} Yeah . But , it 's d it 's after {disfmarker} Well , it 's tandem features , so {disfmarker} Mmm .
Professor E: Yeah .
PhD B: Yeah . We {disfmarker} we have estimation of post posteriors with PLP and with MSG as input ,
Professor E: Yeah .
PhD B: so I don Well . I don't know .
Professor E: That means they 're between zero and one .
PhD B: Mm - hmm .
Professor E: But i it {disfmarker} it {disfmarker} it {disfmarker} it doesn't necessarily {disfmarker} You know , they could be , um {disfmarker} Do - doesn't tell you what the variance of the things is .
PhD B: Mmm . Mm - hmm .
Professor E: Right ? Cuz if you 're taking the log of these things , it could be , uh {disfmarker} Knowing what the sum of the probabilities are , doesn't tell you what the sum of the logs are .
PhD B: Mm - hmm . Yeah .
Professor E: So .
PhD B: Yeah . So we should look at the likelihood , or {disfmarker} or what ? Or {disfmarker} well , at the log , perhaps , and {disfmarker}
Professor E: Yeah . Yeah .
PhD B: Mm - hmm .
Professor E: Or what {disfmarker} you know , what you 're uh {disfmarker} the thing you 're actually looking at .
PhD B: Mm - hmm .
Professor E: So your {disfmarker} your {disfmarker} the values that are {disfmarker} are actually being fed into HTK .
PhD B: Mm - hmm . But {disfmarker}
Professor E: What do they look like ?
PhD F: No And so th the , uh {disfmarker} for the tandem system , the values that come out of the net don't go through the sigmoid . Right ? They 're sort of the pre - nonlinearity values ?
PhD B: Yes .
Professor E: Right . So they 're {pause} kinda like log probabilities is what I was saying .
PhD F: And those {disfmarker} OK . And tho that 's what goes {pause} into {pause} HTK ?
Professor E: Uh , almost . But then you actually do a KLT on them .
PhD F: OK .
Professor E: Um . They aren't normalized after that , are they ?
PhD B: Mmm . No , they are not {disfmarker} no .
Professor E: No . OK . So , um . Right . So the question is {disfmarker} Yeah . Whatever they are at that point , um , are they something for which taking a square root or cube root or fourth root or something like that is {disfmarker} is gonna be a good or a bad thing ? So .
PhD B: Mm - hmm .
Professor E: Uh , and that 's something that nothing {disfmarker} nothing else after that is gonna {disfmarker} Uh , things are gonna scale it {disfmarker} Uh , you know , subtract things from it , scale it from it , but nothing will have that same effect . Um . So . Um . Anyway , eh {disfmarker}
PhD F: Yeah . Cuz if {disfmarker} if the log probs that are coming out of the MSG are really big , the standard {pause} insertion penalty is gonna have very little effect
Professor E: Well , the {disfmarker} Right .
PhD F: compared to , you know , a smaller set of log probs .
Professor E: Yeah . No . Again you don't really {pause} look at that . It 's something {disfmarker} that , and then it 's going through this transformation that 's probably pretty close to {disfmarker} It 's , eh , whatever the KLT is doing . But it 's probably pretty close to what a {disfmarker} a {disfmarker} a discrete cosine transformation is doing .
PhD F: Yeah .
Professor E: But still it 's {disfmarker} it 's not gonna probably radically change the scale of things . I would think . And , uh {disfmarker} Yeah . It may be entirely off and {disfmarker} and it may be {disfmarker} at the very least it may be quite different for MSG than it is for mel cepstrum or PLP . So that would be {disfmarker} So the first thing I 'd look at without adjusting anything would just be to go back to the experiment and look at the , uh , substitutions , insertions , and deletions . And if the {disfmarker} if the , uh {disfmarker} i if there 's a fairly large effect of the difference , say , uh , uh , the r ratio between insertions and deletions for the two cases then that would be , uh , an indicator that it might {disfmarker} might be in that direction .
PhD B: Mm - hmm . Mm - hmm . Yeah . But ,
Professor E: Anything else ?
PhD B: my {disfmarker} my point was more that it {disfmarker} it works sometimes and {disfmarker} but sometimes it doesn't work .
Professor E: Yeah .
PhD B: So .
Professor E: Well .
PhD B: And it works on TI - digits and on SpeechDat - Car it doesn't work , and {disfmarker}
Professor E: Yeah .
PhD B: Mm - hmm . Yeah . Well .
Professor E: But , you know , some problems are harder than others ,
PhD B: Mm - hmm . Yeah .
Professor E: and {disfmarker} And , uh , sometimes , you know , there 's enough evidence for something to work and then it 's harder , it breaks . You know ,
PhD B: Mm - hmm .
Professor E: so it 's {disfmarker} But it {disfmarker} but , um , i it {disfmarker} it could be that when you say it works maybe we could be doing much better , even in TI - digits . Right ?
PhD B: Yeah . Yeah , sure .
Professor E: So .
PhD B: Uh .
Professor E: Hmm ? Yeah .
PhD B: Yeah . Well , there is also the spectral subtraction , which , um {disfmarker} I think maybe we should , uh , try to integrate it in {disfmarker} in our system .
Professor E: Yeah .
PhD B: Mmm . Mm - hmm .
Professor E: Right .
PhD B: But ,
Professor E: O
PhD B: I think that would involve to {disfmarker} {vocalsound} to mmm {vocalsound} use a big {disfmarker} a {disfmarker} al already a big bunch of the system of Ericsson . Because he has spectral subtraction , then it 's followed by , {vocalsound} um , other kind of processing that 's {disfmarker} are dependent on the {disfmarker} uh , if it 's speech or noi or silence .
Professor E: Mm - hmm .
PhD B: And there is this kind of spectral flattening after {disfmarker} if it 's silence , and {disfmarker} and s I {disfmarker} I think it 's important , um , {vocalsound} to reduce this musical noise and this {disfmarker} this increase of variance during silence portions . So . Well . This was in this would involve to take almost everything from {disfmarker} from the {disfmarker} this proposal and {disfmarker} and then just add some kind of on - line normalization in {disfmarker} in the neural network . Mmm .
Professor E: OK . Well , this 'll be , I think , something for discussion with Hynek next week .
PhD B: Yeah . Mm - hmm .
Professor E: Yeah . OK . Right . So . How are , uh , uh {disfmarker} how are things going with what you 're doing ?
Grad D: Oh . Well , um , I took a lot of time just getting my taxes out of the way {disfmarker} multi - national taxes . So , I 'm {disfmarker} I 'm starting to write code now for my work but I don't have any results yet . Um , i it would be good for me to talk to Hynek , I think , when he 's here .
Professor E: Yeah .
Grad D: Do you know what his schedule will be like ?
Professor E: Uh , he 'll be around for three days .
Grad D: OK . So , y
Professor E: Uh , we 'll have a lot of time .
Grad D: OK .
Professor E: So , uh {disfmarker} Um . I 'll , uh {disfmarker} You know , he 's {disfmarker} he 'll {disfmarker} he 'll be talking with everybody in this room So .
PhD F: But you said you won't {disfmarker} you won't be here next Thursday ?
Professor E: Not Thursday and Friday . Yeah . Cuz I will be at faculty retreat .
PhD F: Hmm .
Professor E: So . I 'll try to {vocalsound} connect with him and people as {disfmarker} as I can on {disfmarker} on Wednesday . But {disfmarker} Um . Oh , how 'd taxes go ? Taxes go OK ?
Grad D: Mmm . Yeah .
Professor E: Yeah . Oh , good . Yeah . Yeah . That 's just {disfmarker} that 's {disfmarker} that 's one of the big advantages of not making much money is {vocalsound} the taxes are easier . Yeah .
PhD F: Unless you 're getting money in two countries .
Professor E: I think you are . Aren't you ?
PhD F: They both want their cut .
PhD B: Hmm .
Grad D: Hmm . Yeah .
PhD F: Right ?
Professor E: Yeah . Yeah . Huh . Canada w Canada wants a cut ?
Grad D: Mm - hmm .
Professor E: Have to do {disfmarker} So you {disfmarker} you have to do two returns ?
Grad D: Mmm . W uh , for two thousand I did . Yeah .
Professor E: Oh , oh . Yeah . For tw That 's right , ju
PhD F: But not for this next year ?
Professor E: Two thousand . Yeah . Probably not this next year , I guess .
Grad D: Ye
Professor E: Yeah .
Grad D: Um .
Professor E: Yeah .
Grad D: Uh , I 'll {disfmarker} I 'll still have a bit of Canadian income but it 'll be less complicated because I will not be a {disfmarker} considered a resident of Canada anymore , so I won't have to declare my American income on my Canadian return .
Professor E: OK . Alright . Uh . Barry , do you wanna {pause} say something about your stuff here ?
Grad A: Oh , um . Right . I {pause} just , um , continuing looking at , uh , ph uh , phonetic events , and , uh , this Tuesday gonna be , uh , meeting with John Ohala with Chuck to talk some more about these , uh , ph um , phonetic events . Um , came up with , uh , a plan of attack , uh , gonna execute , and um {disfmarker} Yeah . It 's {disfmarker} that 's pretty much it .
Professor E: Oh , well . No Um , why don't you say something about what it is ?
Grad A: Oh , you {disfmarker} oh , you want {disfmarker} you want details . Hmm . OK .
Professor E: Well , we 're all gathered here together . I thought we 'd , you know {disfmarker}
Grad A: I was hoping I could wave my hands . Um . So , um . So , once wa I {disfmarker} I was thinking getting {disfmarker} getting us a set of acoustic events to {disfmarker} um , to be able to distinguish between , uh , phones and words and stuff . And {vocalsound} um , once we {disfmarker} we would figure out a set of these events that can be , you know , um , hand - labeled or {disfmarker} or derived , uh , from h the hand - labeled phone targets . Um , we could take these events and , um , {vocalsound} do some cheating experiments , um , where we feed , um , these events into {pause} an SRI system , um , eh , and evaluate its performance on a Switchboard task . Uh , yeah .
Grad D: Hey , Barry ? Can you give an example of an event ?
Grad A: Yeah . Sure . Um , I {disfmarker} I can give you an example of {pause} twenty - odd events . Um {disfmarker} So , he In this paper , um , it 's talking about phoneme recognition using acoustic events . So , things like frication or , uh , nasality .
Professor E: Whose paper is it ?
Grad A: Um , this is a paper by Hubener and Cardson {pause} Benson {disfmarker} Bernds - Berndsen .
Professor E: Yeah . Huh . From , uh , University of Hamburg and Bielefeld .
Grad A: Mm - hmm .
Professor E: OK .
Grad A: Um .
PhD F: Yeah . I think the {disfmarker} just to expand a little bit on the idea of acoustic event .
Grad A: Mm - hmm .
PhD F: There 's , um {disfmarker} in my mind , anyways , there 's a difference between , um , acoustic features and acoustic events . And I think of acoustic features as being , um , things that linguists talk about , like , um {disfmarker}
Professor E: So , stuff that 's not based on data .
PhD F: Stuff that 's not based on data , necessarily .
Professor E: Yeah . Oh , OK . Yeah . Yeah , OK .
PhD F: Right . That 's not based on , you know , acoustic data . So they talk about features for phones , like , uh , its height ,
Grad A: Yeah .
PhD F: its tenseness , laxness , things like that ,
Grad A: Mm - hmm .
PhD F: which may or may not be all that easy to measure in the acoustic signal . Versus an acoustic event , which is just {nonvocalsound} some {nonvocalsound} something in the acoustic signal {nonvocalsound} that is fairly easy to measure . Um . So it 's , um {disfmarker} it 's a little different , in {disfmarker} at least in my mind .
Professor E: I mean , when we did the SPAM work {disfmarker} I mean , there we had {disfmarker} we had this notion of an , uh , auditory {disfmarker} @ @ {comment} auditory event .
Grad A: Good . That 's great .
Professor E: And , uh , um , called them " avents " , uh , uh , uh , with an A at the front .
PhD F: Mm - hmm .
Professor E: Uh . And the {disfmarker} the {disfmarker} the idea was something that occurred that is important to a bunch of neurons somewhere . So .
Grad A: Mm - hmm .
Professor E: Um . A sudden change or a relatively rapid change in some spectral characteristic will {disfmarker} will do sort of this . I mean , there 's certainly a bunch of {disfmarker} a bunch of places where you know that neurons are gonna fire because something novel has happened . That was {disfmarker} that was the main thing that we were focusing on there . But there 's certainly other things beyond what we talked about there that aren't just sort of rapid changes , but {disfmarker}
PhD F: It 's kinda like the difference between top - down and bottom - up .
Professor E: Yeah .
PhD F: I think of the acoustic {disfmarker} you know , phonetic features as being top - down . You know , you look at the phone and you say this phone is supposed to be {disfmarker} you know , have this feature , this feature , and this feature . Whether tha those features show up in the acoustic signal is sort of irrelevant . Whereas , an acoustic event goes the other way . Here 's the signal . Here 's some event .
Grad A: Mm - hmm .
PhD F: What {disfmarker} ? And then that {disfmarker} you know , that may map to this phone sometimes , and sometimes it may not . It just depen maybe depends on the context , things like that .
Professor E: Mm - hmm .
PhD F: And so it 's sort of a different way of looking .
Professor E: Mm - hmm .
Grad A: Yeah . So . Yeah .
Grad D: OK .
Grad A: Mm - hmm . Um {disfmarker} Using these {disfmarker} these events , um , you know , we can {disfmarker} we can perform these {disfmarker} these , uh , cheating experiments . See how {disfmarker} how {disfmarker} how good they are , um , in , um {disfmarker} in terms of phoneme recognition or word recognition . And , um {disfmarker} and then from that point on , I would , uh , s design robust event detectors , um , in a similar , um , wa spirit that Saul has done w uh , with his graphical models , and this {disfmarker} this probabilistic AND - OR model that he uses . Um , eh , try to extend it to , um {disfmarker} to account for other {disfmarker} other phenomena like , um , CMR co - modulation release . And , um {disfmarker} and maybe also investigate ways to {disfmarker} to modify the structure of these models , um , in a data - driven way , uh , similar to the way that , uh , Jeff {disfmarker} Jeff , uh , Bilmes did his work . Um , and while I 'm {disfmarker} I 'm doing these , um , event detectors , you know , I can ma mea measure my progress by comparing , um , the error rates in clean and noisy conditions to something like , uh , neural nets . Um , and {disfmarker} So {disfmarker} so , once we have these {disfmarker} these , uh , event detectors , um , we could put them together and {disfmarker} and feed the outputs of the event detectors into {disfmarker} into the SRI , um , HMM {disfmarker} HMM system , and , um {disfmarker} and test it on {disfmarker} on Switchboard or , um , maybe even Aurora stuff . And , that 's pretty much the {disfmarker} the big picture of {disfmarker} of um , the plan .
Professor E: By the way , um , there 's , uh , a couple people who are gonna be here {disfmarker} I forget if I already told you this , but , a couple people who are gonna be here for six months .
Grad A: Mm - hmm .
Professor E: Uh {disfmarker} uh , there 's a Professor Kollmeier , uh , from Germany who 's , uh , uh , quite big in the , uh , hearing - aid signal - processing area and , um , Michael Kleinschmidt , who 's worked with him , who also looks at {vocalsound} auditory properties inspired by various , uh , brain function things .
Grad A: Hmm .
Professor E: So , um , um , I think they 'll be interesting to talk to , in this sort of issue as these detectors are {disfmarker} are , uh , developing .
Grad A: Hmm . OK .
Professor E: So , he looks at interesting {disfmarker} interesting things in {disfmarker} in the {disfmarker} {vocalsound} different ways of looking at spectra in order to {disfmarker} to get various speech properties out . So .
Grad A: OK .
Professor E: OK . Well , short meeting , but that 's OK . And , uh , we might as well do our digits . And like I say , I {disfmarker} I encourage you to go ahead and meet , uh , next week with , uh , uh , Hynek . Alright , I 'll {disfmarker} I 'll start . It 's , uh , one thirty - five . seventeen OK