A fair bit to update on! Let's get into it.
First of all, I've been going through more v1->v2 voice re-training. The 13 re-trained voices are (all Skyrim):
- Serana
- FemaleCondescending
- MaleBrute
- MaleYoungEager
- Frea
- MaleEvenTonedAccented
- MaleDrunk
- Galmar
- Esbern
- Tulius
- Ulfric
- Ko...
So the strawpoll in the last post apparently doesn't work (fab), but I got another poll going on the discord server, and the vote was overwhelmingly (17 for, 6 against) in favour of doing more voice re-training v1->v2, rather than a new set of voices. The re-training is underway for a good number of voices, but a couple are done already that ...
2022-02-15 17:18:07 +0000 UTC View Post
This one's been a long time coming, but it's finally here (and finished).
This is an xVASynth plugin to integrate xVASynth voices into the Fuz Ro Bork mod which adds real-time TTS to the player in Skyrim. This has been a joint effort with the FuzRoBork author to get it to work. Check the video out to see it in action.
The non-e...
2022-02-04 16:46:32 +0000 UTC View PostThe next voices are here!
Had a slight set-back. While integrating the training script into xVATrainer, I found some ways to optimize the training scripts, which also affects the quality (I think for the better - let me know!). This meant a few days of (necessary) re-calibration, but the scripts are now faster, which should hopefully mean ...
2022-02-02 15:31:23 +0000 UTC View PostWhile the poll was going, I spent some gpu time re-training some of the other older v1 voices over to v2, in addition to the ones mentioned in the last post. With this update, we're now at about 20% of the voices having been re-trained to v2. The training scripts are getting faster and faster, with every optimization and tweak. Seems like the we...
2022-01-23 21:34:37 +0000 UTC View Post
Well, it's now been an entire year since I first posted the initial full release of the app, on 11th Jan 2021!
Things have come a long way for xVASynth, from its early days in 2018 (YouTube showcase of v0.1). Since this time last year, we've reached:<...
2022-01-11 12:02:28 +0000 UTC View PostSome new voices from the last poll are here, along with some further v1->v2 re-trained voices.
I actually included one more voice from the poll that didn't win, because I had already trained it before the poll ratings changed order, right at the end. The voices are as follows:
- Skyrim: Florentius
- Fallout New Vegas: FemaleAdu...
I hope everyone's having a great holiday.
I've been taking it a little easier on the voice training, and focused a bit more on re-training some main voices from v1 to v2. I've included them here, as well as some new voices.
The new voices:
- GTA Vice City: Colonel
- GTA Vice City: Diaz
- GTA Vice City: Lance
- Age of ...
This batch is now ready! Aside from the private requests, the winning voices are:
- Cyberpunk: Rogue
- Fallout New Vegas: FemaleOld03
- Dragon Age: Flemeth
- Dragon Age: Greagoir
- Dragon Age: Russel Dorsey
From requests, we also have:
- Cyberpunk: River (aka Sobchak)
- GTA Vice City: Tommy
This introduces ...
2021-12-12 20:24:08 +0000 UTC View PostThe next lot of voices is here (with some v2 re-training of older voices on the way). The winning voices this time are:
- Fallout 4: Travis
- Fallout 3: Moira
- Fallout New Vegas: Ulysses
- Dragon Age: Ser Gilmore
- Fallout 76: Mort
Now, for the Travis voice, if you've played Fallout 4 you might know, there are two stages...
2021-11-25 23:26:34 +0000 UTC View Post
I've been going through some requests (of which one was private), as well as some v1 re-training to v2 models. The voices:
- Fallout 76: GenericSettler03
- (v2 re-trained) Skyrim: FemaleCommander
- (v2 re-trained) Skyrim: MaleNord
- (v2 re-trained) Fallout 4: MrGutsy
- (v2 re-trained) Cyberpunk: Johnny
- Star Wars Jedi Falle...
I spent some time recently, putting together and finalising a series of new tools for data preparation/pre-processing. These are tools that I've already finished integrating into xVATrainer (which is how I use them now!), so I thought I'd quickly cover them here.
Some of these heavily build on top of the previous technical post, so check t...
2021-11-11 18:01:25 +0000 UTC View Post
The voices from the first v2 poll is here! This covers the top voted voices from Poll #30, one of the requested voices, and some re-trained v1 voices. The list:
- Skyrim: Brynjolf
- Skyrim: Hadvar
- Fallout 3: Harkness
- Baldur's Gate: Narrator (BG3)
- Mass Effect: Kelly
- (requested) Fallout 76: MaleGenericSettler02
...
After several months of development, v2.0 of xVASynth is now finally live! The update is now live on the Nexus (Skyrim already, the rest are also coming today, I'm working my way through the slow uploads).
Also releasing today is the initial release of the xVADict community project, for the Elder Scrolls words. This is the ARPAbet dictiona...
2021-10-23 14:20:49 +0000 UTC View PostThe training scripts have been whirring away, and I've actually gotten them to be faster and more high quality still, with some further work.
I've been working through some base voices to use as pre-training, in future voices, as well as some voices for use in the v2.0 showcase video (which is now finished). The v2.0 voices are as fo...
2021-10-21 13:10:11 +0000 UTC View PostJust wanted to make a quick post to update people with what's going on at the moment.
I've been hard at work optimizing the training scripts, and I think I've now got it as good as it's going to get for now. It's definitely faster, now, which is great, but still slower than the v1.0 training script, simply due to the fact that the model is...
2021-10-15 16:28:52 +0000 UTC View PostThe next round of voices is here, with the winning 5 voices from the poll, as well as a bunch from requests. The poll voices are:
- Mass Effect: Jack
- Fallout New Vegas: FemaleOld01
- Fallout New Vegas: FemaleOld02
- Fallout New Vegas: MaleAdult09
- Fallout 3: ElderLyons
And the voices from requests are:
- Mass Eff...
2021-10-02 09:21:04 +0000 UTC View PostHere we go - v2.0 is here! And after a long time trying, so is the new training script for the v2.0 models, using the new and improved FastPitch architecture!
v2.0 is a huge update, with lots of things I've been wanting to add for quite some time, so I'm super excited to get this out.
I'll say a bit about the main features (and a new...
2021-09-30 11:01:37 +0000 UTC View Post
Got a few things, for this post. Let's start with some new voices, to come from requests:
- Borderlands: Tyreen
- Mass Effect: Samara
- Persona: Ren
- Persona: Morgana
- Persona: Kasumi
- Portal: GLaDOS
These now introduce two new game series: Persona, and Portal! Please remember to install the asset files for these, i...
2021-09-21 12:39:00 +0000 UTC View Post
The next batch is here! A fairly big one, as there was a spike in requests (one of which private). The voices from the poll are:
- Fallout 3: MaleAdult06
- Fallout 3: Butch
- Cyberpunk: Rhino
- Cyberpunk: Kerry
- Borderlands: Claptrap
- Borderlands: Jack
The voices from the public requests are:
- Fallout3/4/New V...
2021-09-10 16:19:49 +0000 UTC View PostA few more voices are now finished, from requests and the previous poll:
- Skyrim: Adril
- Skyrim: Galmar
- Fallout New Vegas: FemaleAdult01Default
- Fallout New Vegas: MaleAdult08
- Fallout New Vegas: Veronica
- Fallout New Vegas: Mr. House
- Cyberpunk: Sebastian
- Dragon Age: Sten
- Dragon Age: Wynne
[EDIT] ...
2021-08-30 16:08:23 +0000 UTC View Post
The votes are in, and the voices are done! The winning poll choices are:
- Skyrim: Dexion
- Fallout New Vegas: Dean
- Fallout New Vegas: MaleOld01
- Fallout 3: FemaleAdult01Default
- Borderlands: Lilith
- Borderlands: Brick
I also did a voice I myself personally wanted, for Humankind, the new 4x game, just because I tr...
2021-08-21 08:50:05 +0000 UTC View PostWe're nearing the end of the Skyrim voice list, with most/all of the remaining ones being voices from previous polls which did not get picked.
If you've missed it, I've also updated some of the existing Skyrim voices to have Tacotron2 pre-training and HiFi models:
- FemaleDarkElfCommoner
- MaleSoldier
- FemaleOldKindly <...
[EDIT 23/10/2021]: The team fortress 2 voices are really not that good at the moment, but I think I can greatly improve them with the v2.0 models. I will make another pass on them soon.
Another big round, having finished off more voices from a spike in requests, and the poll. This time covering an additional 3 newly supported games. The vo...
2021-08-13 08:19:20 +0000 UTC View PostGot a big batch of requested voices, covering all the voices from the Overwatch game (apart from bastion, which is just robot beeps). The Overwatch voices were for some reason really quick to train (maybe shorter lines?), so I got through them comparatively quite quickly.
So the list is:
- Ana
- Ashe
- Baptiste
- Brigitte
A big one this time. I had a spike in requests, so I've been quite busy!
As I do more and more voices, I keep finding myself learning new things about the games I thought I knew well. I never knew that for GTA:SA, the main character (CJ) actually has a different voice (acted differently, same voice actor), for when you play him as ov...
2021-08-03 20:06:55 +0000 UTC View PostHi everyone, I just wanted to make a quick announcement post regarding some changes to the Patreon structure.
The next big update for the app will be a big one. In fact, I re-wrote the majority of the app, and there are enough big new features that I think it's time we move up to v2.0!
I didn't want to reveal anything too early, but ...
2021-08-03 17:34:40 +0000 UTC View PostMore voices dropping:
- Skyrim: Modyn
- Skyrim: Elenwen
- Skyrim: FemaleVampire
- Skyrim: Fura
- Fallout New Vegas: MaleAdult06
- Fallout New Vegas: MaleAdult07
- Fallout New Vegas: FemaleGenericGhoul
There are also two extra voices included, from requests:
- Skyrim: Astrid
- Skyrim: Valerica
These t...
2021-07-25 12:18:00 +0000 UTC View PostThe latest poll is now ready. This includes the following voices:
- Skyrim: Delvin
- Skyrim: MaleVampire
- Skyrim: Nazir
- Skyrim: Odahviing
- Fallout 3: FemaleOld01
- Cyberpunk: Misty
- Cyberpunk: Placide
The next poll will follow very soon. I do however have some time off from work this coming week, so I will aim ...
2021-07-11 12:11:12 +0000 UTC View PostOk, this post will go a little deeper than the others. I've been working on something else, in the background, called representation learning. This actually very closely aligns with what I actually do day-to-day as part of my PhD, so it's been quite a bit of fun.
Representation learning is a whole ma...
2021-07-02 10:17:32 +0000 UTC View Post