Turok: Dinosaur Hunter Forums!

Turok Games => Turok 3 Shadow of Oblivion => Topic started by: TurokTheMan on July 23, 2018, 12:58:02 AM

Title: N64UNPAK Tool ?
Post by: TurokTheMan on July 23, 2018, 12:58:02 AM
Hey, I have something to share with you all I am doing a secret project for "Turok 3 Shadows of Oblivion" and what I needed was an extractor tool to Dump all the contents from a ".n64 Rom" or N64 File if you want to call it that
So I searched and searched honestly for about 4 months asking on all forums searching for an extractor tool for that reason on why I wanted it so I give up searching but I did manage to find 2 extractor tools for ".N64" Files that would extract music files only and
models only so one could extract the models and the other could only extract the music files from the ".N64 File" So I decided that I needed this tool for my secret project so either way I decided to make my own tool for extracting all the contents from the ".N64 File" and dumping the contents to a folder directory So I have almost finished the tool but I will show a video very soon so sorry for not having any proof or images or videos but I just thought I would share this to all that would love to have this tool I mean just think on the PC Ports and mods we could make with this tool it could help out devs and modders alike for sure. :oblivion: :grin:
Title: Re: N64UNPAK Tool ?
Post by: Dinomite on July 23, 2018, 04:12:49 AM
Sounds interesting
Title: Re: N64UNPAK Tool ?
Post by: Rok on July 23, 2018, 10:04:29 AM
Nice! But yes without proof its a void until we see. But that sounds awesome. Welcome btw.
Title: Re: N64UNPAK Tool ?
Post by: TurokTheMan on July 23, 2018, 12:11:47 PM
Thanks for the welcome glad to be here.
Title: Re: N64UNPAK Tool ?
Post by: TurokTheMan on July 23, 2018, 01:58:31 PM
Hey, A Question for you all would you like me to add a function for reimporting files back into the ".N64 File" if so let me know thanks basically a "Reimporting feature for the N64UNPAK Tool". :grin:
Title: Re: N64UNPAK Tool ?
Post by: Duke64 on July 23, 2018, 11:01:13 PM
Very interesting idea for a tool.

Hey, A Question for you all would you like me to add a function for reimporting files back into the ".N64 File" if so let me know thanks basically a "Reimporting feature for the N64UNPAK Tool". :grin:

My suggestion would be make your tool do as much as you can make it do ;) You could always update in the future with more features like that if you wanted or not etc.
Title: Re: N64UNPAK Tool ?
Post by: Dinomite on July 24, 2018, 08:27:41 AM
My suggestion would be make your tool do as much as you can make it do ;) You could always update in the future with more features like that if you wanted or not etc.
I second that. That would be for the best. :)
Title: Re: N64UNPAK Tool ?
Post by: TurokTheMan on July 24, 2018, 09:09:26 AM
Okay, thanks for the advice
Title: Re: N64UNPAK Tool ?
Post by: Jay Doomed on July 24, 2018, 03:09:05 PM
 :campaigner: :campaigner: :campaigner: :campaigner: :campaigner:
Title: Re: N64UNPAK Tool ?
Post by: TurokTheMan on July 24, 2018, 09:48:28 PM
I added a walkthrough to the tool so you don't have to guess on what you need to type okay thought I would share that with you almost done tho with the tool working out some kinks right now and dealing with work also so not much time at the moment tho.
Title: Re: N64UNPAK Tool ?
Post by: TurokTheMan on July 25, 2018, 03:31:21 AM
Hey, I thought I would share also with you all that I just got done adding support for the following rom's and file extensions with the tool "N64UNPAK Tool"

Supported Extraction, reimport: Roms

Atari 7800
Atari Jaguar
Capcom Play System 1
Capcom Play System 2
GameBoy Advance
GameBoy Color
M.A.M.E
Nintendo 64
Namco System 12
Nintendo DS
Nintendo Game Boy
Nintendo Virtual Boy
Sega 32X
Sega Genesis - Sega Megadrive
Sega Master System
Super Nintendo

Supported Extraction, reimport: Roms: file extension archives.

".n64";            // nintendo 64 file extension
".sfc";            // super nintendo file extension
".gba";            // gameboy advance file extension
".j64";            // Atari Jaguar file extension
".03d";            // M.A.M.E file extension
".04d";            // M.A.M.E file extension
".mro";            // M.A.M.E file extension
".fmem1";          // M.A.M.E file extension
".ic23";           // M.A.M.E file extension
".a78";            // Atari 7800 file extension
".gb";             // nintendo gameboy file extension
".gbc";            // nintendo gameboy color file extension
".rom";            // Capcom Play System 1 file extension
".01";             // Capcom Play System 2 file extension
".02";             // Capcom Play System 2 file extension
".05a";            // Capcom Play System 2 file extension
".06a";            // Capcom Play System 2 file extension
".07";             // Capcom Play System 2 file extension
".08";             // Capcom Play System 2 file extension
".09";             // Capcom Play System 2 file extension
".10";             // Capcom Play System 2 file extension
".11m";            // Capcom Play System 2 file extension
".12m";            // Capcom Play System 2 file extension
".13m";            // Capcom Play System 2 file extension
".14m";            // Capcom Play System 2 file extension
".15m";            // Capcom Play System 2 file extension
".16m";            // Capcom Play System 2 file extension
".17m";            // Capcom Play System 2 file extension
".18m";            // Capcom Play System 2 file extension
".19m";            // Capcom Play System 2 file extension
".20m";            // Capcom Play System 2 file extension
".03a";            // Capcom Play System 2 file extension
".04a";            // Capcom Play System 2 file extension
".6";              // Namco System 12 file extension
".5";              // Namco System 12 file extension
".7";              // Namco System 12 file extension
".8";              // Namco System 12 file extension
".9";              // Namco System 12 file extension
".2l";             // Namco System 12 file extension
".2p";             // Namco System 12 file extension
".2";              // Namco System 12 file extension
".nds";            // nintendo ds file extension
".32x";            // Sega 32X file extension
".md";             // Sega Genesis - Sega Megadrive file extension
".sms";            // Sega Master System file extension

Keep you all updated as I get to the finish line with the tool. :grin:



Title: Re: N64UNPAK Tool ?
Post by: Jay Doomed on July 25, 2018, 02:54:48 PM
So cool that its hard to believe, can't wait to explore this!
Title: Re: N64UNPAK Tool ?
Post by: TurokTheMan on July 25, 2018, 06:48:46 PM
Well, I thought I would at least make this tool the best one to have.
Title: Re: N64UNPAK Tool ?
Post by: Dinomite on July 26, 2018, 02:03:03 AM
This all sounds very nice, but not all games are the same in terms of compression even if they share the same extension so I dont know if this will be 100% compatible with things. But any% is better then nothing. :)
Title: Re: N64UNPAK Tool ?
Post by: TurokTheMan on July 26, 2018, 05:08:38 AM
Yeah, true I have looked into the compression issues with most games on different systems so I am coding them now to make them more compatible so they will be able to be extracted and reimported if I need them to.
Title: Re: N64UNPAK Tool ?
Post by: TurokTheMan on July 26, 2018, 05:10:41 AM
I wanted this tool to support many games that can allow devs to extract their content from there game archive files and reimport the files back into there game archive files just making this tool the best I can before the first release.
Title: Re: N64UNPAK Tool ?
Post by: TurokTheMan on July 26, 2018, 10:21:11 AM
I've added support this morning for how many bytes can be read and written to the hard disk from each .extension or archive once extraction of the archive has been commanded so the program will now extract archives bigger or small archives depending on the bytes read by the program so you can extract archives up to 1 TB if you choose to do so which I think its a little overboard but still kinda cool anyway tho. :have a nice day:
Title: Re: N64UNPAK Tool ?
Post by: Jay Doomed on July 30, 2018, 01:03:13 PM
So how about models, how will they extract if you unpak them? Format?
Title: Re: N64UNPAK Tool ?
Post by: Dinomite on July 30, 2018, 04:47:47 PM
So how about models, how will they extract if you unpak them? Format?
I was wondering about that too. :)
Title: Re: N64UNPAK Tool ?
Post by: TurokTheMan on July 31, 2018, 01:16:04 PM
So how about models, how will they extract if you unpak them? Format?

I will give some code examples later on this week or next week due to later dates because of overtime work I've got to do. That will explain more about what methods I am choosing to do for the extraction of all contents or data from the ".n64 or any archive that the program supports". :grin:
Title: Re: N64UNPAK Tool ?
Post by: TurokTheMan on July 31, 2018, 01:27:08 PM
So how about models, how will they extract if you unpak them? Format?
I was wondering about that too. :)

Well, All the program is doing here is its reading the archive and extracting all contents from the ".n64 or any archive that the program supports" and dumping it to a directory it does not read inside of the archive like you think it just reads the amount of bytes the archive is compressed with keyword "Memory" and then extracts the data using a command line parameters for example "-ex", "for extracting the archive" and dumps all the data from the archive, not just the data that is Pacific to the file extension so it extracts all data, not just models. Also some file compressed archives have encryption so I made a option to bypass the encryption only if the bytes keyword 'Memory" is Greater than "120Mbs" So if it goes any further than this memory limitation the archive will call an ASCII error that says the archive is not reachable due to memory access limitations I have not tested this method but I am sure it does alright also the ".n64 compressed archives" have no encryption as far as I can see on some Nintendo 64  compressed archvies so that is a very good thing indeed.
Title: Re: N64UNPAK Tool ?
Post by: Rok on August 02, 2018, 01:50:42 AM
I think I speak for many can't wait to see this!  :feather:
Title: Re: N64UNPAK Tool ?
Post by: TurokTheMan on August 02, 2018, 02:10:44 AM
I think I speak for many can't wait to see this!  :feather:

Can't wait to get it done and release it to the public myself
Title: Re: N64UNPAK Tool ?
Post by: Dinomite on September 03, 2018, 05:50:37 PM
Please tell me this is still being worked on... This tool sounds so great, I really wanna use it.
Title: Re: N64UNPAK Tool ?
Post by: TurokTheMan on September 07, 2018, 12:10:01 PM
Please tell me this is still being worked on... This tool sounds so great, I really wanna use it.

Yes, this is still being worked on just been very busy with work and mowing jobs etc, so my time has been limited and had to deal with a lot of family drama so I am getting some more time to work on this project very soon thanks.
Title: Re: N64UNPAK Tool ?
Post by: Dinomite on September 07, 2018, 01:12:50 PM
Alright, we understand.
Title: Re: N64UNPAK Tool ?
Post by: Jay Doomed on September 07, 2018, 01:22:45 PM
That's okay we arent going anywhere so take your time. Nice to hear something on it though!
Title: Re: N64UNPAK Tool ?
Post by: TurokTheMan on September 07, 2018, 01:43:26 PM
That's okay we arent going anywhere so take your time. Nice to hear something on it though!
I will keep you all updated as I make more progress so you all can know what progress I am making on the project thanks.
Title: Re: N64UNPAK Tool ?
Post by: Dinomite on September 09, 2018, 07:59:21 AM
 :feather:
Title: Re: N64UNPAK Tool ?
Post by: TurokTheMan on October 03, 2018, 08:06:01 PM
Hey, Update on the project I have been very busy at work not much time to work on the code but I have finally got some code done back onto it now so more updates coming soon.
So Sorry Its just the overtime at work I am very busy this time of year tho but either way I am sorry for the big delay.
Title: Re: N64UNPAK Tool ?
Post by: Dinomite on October 07, 2018, 05:57:39 AM
Its alright.
Title: Re: N64UNPAK Tool ?
Post by: TurokTheMan on November 19, 2018, 08:46:59 PM
Hey, Guys Ive been so busy with work lately Ive had to also get through school also been very busy.
Just to let you know that this project is still active.
Title: Re: N64UNPAK Tool ?
Post by: Jay Doomed on November 20, 2018, 10:27:16 AM
Thanks for checking in. No problem good luck with your life stuff.  :campaigner:
Title: Re: N64UNPAK Tool ?
Post by: Dinomite on November 20, 2018, 10:58:35 AM
Thanks for checking in. No problem good luck with your life stuff.  :campaigner:
Exactly.
Title: Re: N64UNPAK Tool ?
Post by: Duke64 on November 22, 2018, 11:38:15 PM
Hope things are going well.

Just a random thought but could this tool possibly help with extracting level models from games like Shadowman for example. That game is troublesome the model format was something weird too. I have been unable to get clean exports on that one in particular.
Title: Re: N64UNPAK Tool ?
Post by: TurokTheMan on January 19, 2019, 11:17:05 PM
Hope things are going well.

Just a random thought but could this tool possibly help with extracting level models from games like Shadowman for example. That game is troublesome the model format was something weird too. I have been unable to get clean exports on that one in particular.

Sure, I can make it compatible depends on the data packed in the "n64 Rom".

Update, on my progress on this tool I apologize I've been dealing with some important family stuff lately
But, I did get a big chunk of the code done but I am stopped due to trying to understand some data from the "N64 Rom" so
I know what to do next Because I have been doing some serious testing on other "N64 Roms" out there too see if they too use
the same file system &  structures and so on.
So, I want this tool well I want is a different issue but I am trying to code this tool to extract any "N64 RoM".
So, in other words a universal "N64 Rom Extractor" which I think is a very good Idea indeed so this is what Is been holding me up
On getting the project done in time so the only thing I can do is keep you all updated every month to give updates.  :have a nice day:
Title: Re: N64UNPAK Tool ?
Post by: TurokTheMan on February 05, 2019, 10:29:39 PM
Hope things are going well.

Just a random thought but could this tool possibly help with extracting level models from games like Shadowman for example. That game is troublesome the model format was something weird too. I have been unable to get clean exports on that one in particular.

Sure, I can make it compatible depends on the data packed in the "n64 Rom".

Update, on my progress on this tool I apologize I've been dealing with some important family stuff lately
But, I did get a big chunk of the code done but I am stopped due to trying to understand some data from the "N64 Rom" so
I know what to do next Because I have been doing some serious testing on other "N64 Roms" out there too see if they too use
the same file system &  structures and so on.
So, I want this tool well I want is a different issue but I am trying to code this tool to extract any "N64 RoM".
So, in other words a universal "N64 Rom Extractor" which I think is a very good Idea indeed so this is what Is been holding me up
On getting the project done in time so the only thing I can do is keep you all updated every month to give updates.  :have a nice day:

Update 3.3 :have a nice day:

I found out that each n64 rom holds these file types "png , wav , map, exe, dll , cfg" So these files can be extracted from the roms easily.
I've also got done the  classes for open read write so next is to do some classes for opening pacific file extensions
Then, make some read and write classes for pacific file extensions.
may need some libs for this tho.
But, A question for anybody that can answer it which model file extensions was used for n64 games. Like did shadow-man n64 use 3d models or sprite-batches
Title: Re: N64UNPAK Tool ?
Post by: TurokTheMan on February 09, 2019, 06:40:40 AM
Hope things are going well.

Just a random thought but could this tool possibly help with extracting level models from games like Shadowman for example. That game is troublesome the model format was something weird too. I have been unable to get clean exports on that one in particular.

Sure, I can make it compatible depends on the data packed in the "n64 Rom".

Update, on my progress on this tool I apologize I've been dealing with some important family stuff lately
But, I did get a big chunk of the code done but I am stopped due to trying to understand some data from the "N64 Rom" so
I know what to do next Because I have been doing some serious testing on other "N64 Roms" out there too see if they too use
the same file system &  structures and so on.
So, I want this tool well I want is a different issue but I am trying to code this tool to extract any "N64 RoM".
So, in other words a universal "N64 Rom Extractor" which I think is a very good Idea indeed so this is what Is been holding me up
On getting the project done in time so the only thing I can do is keep you all updated every month to give updates.  :have a nice day:

"UPDATE 4.4" "BIG ANNOUNCEMENT"

Hey, guys I want to give another update on my progress of the tool.
I've also got a pic to show as well but as of know.
""Here is the pic https://imgur.com/a/cSYVZaZ ""

Yesterday, I got done the extraction classes for the files "png , dll "
So, I lack a couple more classes for the other files as well.
But, I've got the interface done for the tool as well.
I've also, added a support feature for repacking the ROM.
So, for example you could make a HD texture pack for the game lets say for example "Turok"
So, with my tool you could repack the HD textures back into the ROM and play the ROM on a emulator with the new hd textures which is cool to.
So, it introduces modding to the N64 which is something we need for sure.

I have 1 big announcement.
I decided when I get this tool done I am making a PC port of Turok 3 shadows of oblivion for PC.
So, there will be a port of the 3rd installment of Turok for PC finally after so many years.
So, thanks for all your all's patience with me I'm still hard at work on this tool but so close to getting it done.

Any, Questions you might have feel free to ask them.
Thank you, and have a wonderful Saturday. :have a nice day:
Title: Re: N64UNPAK Tool ?
Post by: Raffine52 on February 09, 2019, 08:10:10 PM
Hope things are going well.

Just a random thought but could this tool possibly help with extracting level models from games like Shadowman for example. That game is troublesome the model format was something weird too. I have been unable to get clean exports on that one in particular.

Sure, I can make it compatible depends on the data packed in the "n64 Rom".

Update, on my progress on this tool I apologize I've been dealing with some important family stuff lately
But, I did get a big chunk of the code done but I am stopped due to trying to understand some data from the "N64 Rom" so
I know what to do next Because I have been doing some serious testing on other "N64 Roms" out there too see if they too use
the same file system &  structures and so on.
So, I want this tool well I want is a different issue but I am trying to code this tool to extract any "N64 RoM".
So, in other words a universal "N64 Rom Extractor" which I think is a very good Idea indeed so this is what Is been holding me up
On getting the project done in time so the only thing I can do is keep you all updated every month to give updates.  :have a nice day:

"UPDATE 4.4" "BIG ANNOUNCEMENT"

Hey, guys I want to give another update on my progress of the tool.
I've also got a pic to show as well but as of know.
""Here is the pic https://imgur.com/a/cSYVZaZ ""

Yesterday, I got done the extraction classes for the files "png , dll "
So, I lack a couple more classes for the other files as well.
But, I've got the interface done for the tool as well.
I've also, added a support feature for repacking the ROM.
So, for example you could make a HD texture pack for the game lets say for example "Turok"
So, with my tool you could repack the HD textures back into the ROM and play the ROM on a emulator with the new hd textures which is cool to.
So, it introduces modding to the N64 which is something we need for sure.

I have 1 big announcement.
I decided when I get this tool done I am making a PC port of Turok 3 shadows of oblivion for PC.
So, there will be a port of the 3rd installment of Turok for PC finally after so many years.
So, thanks for all your all's patience with me I'm still hard at work on this tool but so close to getting it done.

Any, Questions you might have feel free to ask them.
Thank you, and have a wonderful Saturday. :have a nice day:

I love this. I can't wait to see it done.
Title: Re: N64UNPAK Tool ?
Post by: TurokTheMan on February 10, 2019, 09:44:56 AM
Hope things are going well.

Just a random thought but could this tool possibly help with extracting level models from games like Shadowman for example. That game is troublesome the model format was something weird too. I have been unable to get clean exports on that one in particular.

Sure, I can make it compatible depends on the data packed in the "n64 Rom".

Update, on my progress on this tool I apologize I've been dealing with some important family stuff lately
But, I did get a big chunk of the code done but I am stopped due to trying to understand some data from the "N64 Rom" so
I know what to do next Because I have been doing some serious testing on other "N64 Roms" out there too see if they too use
the same file system &  structures and so on.
So, I want this tool well I want is a different issue but I am trying to code this tool to extract any "N64 RoM".
So, in other words a universal "N64 Rom Extractor" which I think is a very good Idea indeed so this is what Is been holding me up
On getting the project done in time so the only thing I can do is keep you all updated every month to give updates.  :have a nice day:

"UPDATE 4.4" "BIG ANNOUNCEMENT"

Hey, guys I want to give another update on my progress of the tool.
I've also got a pic to show as well but as of know.
""Here is the pic https://imgur.com/a/cSYVZaZ ""

Yesterday, I got done the extraction classes for the files "png , dll "
So, I lack a couple more classes for the other files as well.
But, I've got the interface done for the tool as well.
I've also, added a support feature for repacking the ROM.
So, for example you could make a HD texture pack for the game lets say for example "Turok"
So, with my tool you could repack the HD textures back into the ROM and play the ROM on a emulator with the new hd textures which is cool to.
So, it introduces modding to the N64 which is something we need for sure.

I have 1 big announcement.
I decided when I get this tool done I am making a PC port of Turok 3 shadows of oblivion for PC.
So, there will be a port of the 3rd installment of Turok for PC finally after so many years.
So, thanks for all your all's patience with me I'm still hard at work on this tool but so close to getting it done.

Any, Questions you might have feel free to ask them.
Thank you, and have a wonderful Saturday. :have a nice day:

I love this. I can't wait to see it done.


Me, too I'm excited to release the tool and start the turok 3 PC port.
Title: Re: N64UNPAK Tool ?
Post by: Dinomite on April 09, 2019, 04:34:08 PM
I wonder.
Title: Re: N64UNPAK Tool ?
Post by: TurokTheMan on April 19, 2019, 10:11:41 AM
Hope things are going well.

Just a random thought but could this tool possibly help with extracting level models from games like Shadowman for example. That game is troublesome the model format was something weird too. I have been unable to get clean exports on that one in particular.

Sure, I can make it compatible depends on the data packed in the "n64 Rom".

Update, on my progress on this tool I apologize I've been dealing with some important family stuff lately
But, I did get a big chunk of the code done but I am stopped due to trying to understand some data from the "N64 Rom" so
I know what to do next Because I have been doing some serious testing on other "N64 Roms" out there too see if they too use
the same file system &  structures and so on.
So, I want this tool well I want is a different issue but I am trying to code this tool to extract any "N64 RoM".
So, in other words a universal "N64 Rom Extractor" which I think is a very good Idea indeed so this is what Is been holding me up
On getting the project done in time so the only thing I can do is keep you all updated every month to give updates.  :have a nice day:

"UPDATE 4.4" "BIG ANNOUNCEMENT"

Hey, guys I want to give another update on my progress of the tool.
I've also got a pic to show as well but as of know.
""Here is the pic https://imgur.com/a/cSYVZaZ ""

Yesterday, I got done the extraction classes for the files "png , dll "
So, I lack a couple more classes for the other files as well.
But, I've got the interface done for the tool as well.
I've also, added a support feature for repacking the ROM.
So, for example you could make a HD texture pack for the game lets say for example "Turok"
So, with my tool you could repack the HD textures back into the ROM and play the ROM on a emulator with the new hd textures which is cool to.
So, it introduces modding to the N64 which is something we need for sure.

I have 1 big announcement.
I decided when I get this tool done I am making a PC port of Turok 3 shadows of oblivion for PC.
So, there will be a port of the 3rd installment of Turok for PC finally after so many years.
So, thanks for all your all's patience with me I'm still hard at work on this tool but so close to getting it done.

Any, Questions you might have feel free to ask them.
Thank you, and have a wonderful Saturday. :have a nice day:

I love this. I can't wait to see it done.

I wonder.

Update:: 4/19/2019 Hey, fellow Turok players, I finally got done the extractor tool,
but there is an issue when I tried to extract the Turok 3.n64 file it gave me a compression error
Upon, doing the research I found out here http://en64.shoutwiki.com/wiki/N64_Compression
that, this tool needs to support all n64 compression types for me to be able to extract all data from the
n64 files from any n64 game I'm well sure that the other systems like the 3d0, Dreamcast, and others have there own compression types
as well.
So, I'm trying my best to code all compression types so the n64 tool will support them so I can get all data from the .n64 files.

It delays, me to get this tool out but it is worth it to be able to extract all data from any n64 game, not just a selective one.
I'm, sure that other modders would want to extract all data from other n64 games as well so this feature needs to be added.
Title: Re: N64UNPAK Tool ?
Post by: Dinomite on April 20, 2019, 10:39:24 PM
Good to hear an update from ya. Keep up the good work. Could you possibly provide us with a screenshot of the program?
Title: Re: N64UNPAK Tool ?
Post by: TurokTheMan on April 21, 2019, 10:24:32 PM
Good to hear an update from ya. Keep up the good work. Could you possibly provide us with a screenshot of the program?

Yeah, sure Here is go: https://imgur.com/QRinUFr
Just, click the link and click the image to enlarge it.