Using Hardware Antialiasing in PCSX2 !

NexXxus · May 21st, 2008

Now i finally found out how it works

It only works with GSdx in DX9 Fullscreen mode.
It does not work with ZeroGS, GSdx windowed or DX10 mode.
It may work with ATI cards, but i don't know a tool for that.

here is a small tutorial for Nvidia cards:

1.) Make sure you're using the latest Nvidia Forceware driver
(it may work with beta drivers too, but i didn't test it.)
2.) Download nHancer and install it.
3.) Get the latest GSdx version, link in my signature
4.) run nHancer
5.) enable options/Allow override of predefined settings,
6.) create a new profile, name it PCSX2.
7.) select the PCSX2 profile and add all pcsx2 exe's you're currently using.
8.) under the enhancements tab, select an Anti-Aliasing mode, i used Multisampling/4X that looks fine.
be warned that an higher antialiasing mode can slow down a game from 60 to 5fps!
9.) go to the compatiblity tab and check Anti-Aliasing compatiblity, select the "Stalker" or "Vengard" Compatiblity mode.
10.) run pcsx2 and configure GSdx
11.) under resolution,select your native display resolution
(example: for 22" widescreens its 1680x1050, 19" 4/3 would be 1280x1024,
you can select lower resolutions like 1024x768 or 800x600, but you must use the same resolution for the internal d3d resolution!)
12.) The D3D internal res have to match with the fullscreen resolution, otherwise it will not work.
If you selected 1680x1050, then type 1680x1050, 1280x1024 then 1280x1024... and so on...
13.) run a game and hope it'll work.

Important!
If you notice crashes and instability problems of your System use "Vengard" as Compatiblity mode instead Stalker!

i tested it with FFX-2 and it works fine.
FFX works fine too, but there is one thin horizontal line at the lower screen in movies.

here some compare shots:

__________________

My System: C2D E6700 @3.4ghz | Asus P5W DH Deluxe | 4GB DDR2 800 | eVGA Geforce GTX 260 55nm SC-Edition
Tutorial: Hardware Antialiasing in PCSX2 (DX9 only)

Last edited by NexXxus; July 18th, 2009 at 03:35.

**cottonvibes** · May 21st, 2008

can you post some comparison pics?

and does it look better than just using double internal resolution?

__________________

Quote:

Eccentricity is often associated with genius, giftedness, or creativity. The individual's eccentric behavior is perceived to be the outward expression of his or her unique intelligence or creative impulse. In this vein, the eccentric's habits are incomprehensible not because they are illogical or the result of madness, but because they stem from a mind so original that it cannot be conformed to societal norms.

check out my blog

Nightmare85 · May 21st, 2008

Godlike!

__________________
Greets---N--i--g--h--t--m a--r--e

Intel Core 2 Duo E8400 @ 3,2 GHZ (1,184 V) with Noctua NH12F, XFX GeForce 8800 GTS G92, Kingston HyperX KHX6400D2LLK2/2G (4x 1 GB DDR2-800 CL 4-4-4-12), Asus P5E, Creative X-Fi Xtreme Gamer Fatal1ty Pro with Logitech X-540, Tagan TG580-U22 2force 580 Watt, Western Digital WD6400AAKS + 250 GB external HDD + 80 GB iPod, LG GSA-H10NBB, Logitech G9, Logitech G15, Logitech Cordless Rumblepad 2, Logitech Rumblepad 2 refresh, Cooler Master Cavalier (Window-Kit), 22" TFT monitor, WinXP Pro SP3

Mkilbride2588 · May 21st, 2008

Wow, we already have enough trouble running these games at super high resolution and now AA is introduced...we're going to need 2-3 future generation cards to do 16x AA Super-Sampling...even though, with that enabled, Native would be godlike, but imagine like 1920 x 1200 @ 16x AA, with Super-Sampling and Trin filtering...FFX would look next Gen :P

__________________
PC configuration

Q6600 @ 3.4GHZ Stable,GeForce 8800 GT 512 MB GDDR3(Super-clocked) ,4GB PC8000(1000MHZ) RAM @ 950MHZ(5-5-5-15)(Waiting to tweak them eventually),Windows XP SP2 Professional(Vista 64 bit, Dual Boot),750GB 7200 RPM, 32 MB Cache Hard-drive(SATAII),24'' LCD( I know, sorry CRT'ers) HD 1080pi, DVI connected, 1920 x 1200 @ 60HZ),P35-DS3L Revision 2.0 @ 1.49V

http://tinyurl.com/2zzzsr

Use the Guide above to get PCSX2 to run properly. Has all you need to know to run PCSX2.

Having trouble with a game? Check here:
http://tinyurl.com/2cuzhx

NexXxus · May 21st, 2008

it looks a bit better than doubled internal res like 3360x2100.
i can post screens later.

__________________

My System: C2D E6700 @3.4ghz | Asus P5W DH Deluxe | 4GB DDR2 800 | eVGA Geforce GTX 260 55nm SC-Edition
Tutorial: Hardware Antialiasing in PCSX2 (DX9 only)

lightchris · May 21st, 2008

Yep, I already noticed this way to use AA in PCSX2 some while ago. I can confirm that it works, at least with graphics cards of the GeForce 8xxx/9xxx series.

Sadly it's barely faster than increasing the internal rendering resolution in the games i tried. So it's relatively useless to me.

Btw. I remember some other compatibility settings than "STALKER" were also working, giving slightly different results in image quality or speed.

Nightmare85 · May 21st, 2008

First is without AA and the second is with 4x MSAA.
Look especially at the ground!
Internal and external resolution are of course the same!

Attached Images

	373D+svnpcsx2 2008-05-21 22-53-33-03.jpg (196.9 KB, 629 views)
	373D+svnpcsx2 2008-05-21 22-54-20-93.jpg (199.2 KB, 601 views)

__________________
Greets---N--i--g--h--t--m a--r--e

Intel Core 2 Duo E8400 @ 3,2 GHZ (1,184 V) with Noctua NH12F, XFX GeForce 8800 GTS G92, Kingston HyperX KHX6400D2LLK2/2G (4x 1 GB DDR2-800 CL 4-4-4-12), Asus P5E, Creative X-Fi Xtreme Gamer Fatal1ty Pro with Logitech X-540, Tagan TG580-U22 2force 580 Watt, Western Digital WD6400AAKS + 250 GB external HDD + 80 GB iPod, LG GSA-H10NBB, Logitech G9, Logitech G15, Logitech Cordless Rumblepad 2, Logitech Rumblepad 2 refresh, Cooler Master Cavalier (Window-Kit), 22" TFT monitor, WinXP Pro SP3

**cottonvibes** · May 21st, 2008

very hard to notice, but on the ground i can see it does fix those jaggy lines.

maybe it'll look more noticeable in other games.

__________________

Quote:

Eccentricity is often associated with genius, giftedness, or creativity. The individual's eccentric behavior is perceived to be the outward expression of his or her unique intelligence or creative impulse. In this vein, the eccentric's habits are incomprehensible not because they are illogical or the result of madness, but because they stem from a mind so original that it cannot be conformed to societal norms.

check out my blog

Mkilbride2588 · May 21st, 2008

Yeah...I was hoping AA would help alot more...but it's not really at all.

__________________
PC configuration

Q6600 @ 3.4GHZ Stable,GeForce 8800 GT 512 MB GDDR3(Super-clocked) ,4GB PC8000(1000MHZ) RAM @ 950MHZ(5-5-5-15)(Waiting to tweak them eventually),Windows XP SP2 Professional(Vista 64 bit, Dual Boot),750GB 7200 RPM, 32 MB Cache Hard-drive(SATAII),24'' LCD( I know, sorry CRT'ers) HD 1080pi, DVI connected, 1920 x 1200 @ 60HZ),P35-DS3L Revision 2.0 @ 1.49V

http://tinyurl.com/2zzzsr

Use the Guide above to get PCSX2 to run properly. Has all you need to know to run PCSX2.

Having trouble with a game? Check here:
http://tinyurl.com/2cuzhx

**cottonvibes** · May 21st, 2008

i think if you use native resolution, with AA, it might be more noticible.

since native resolution usually has alot of jaggy edges.

and it would be good for the games that don't work with high internal resolutions.

__________________

Quote:

Eccentricity is often associated with genius, giftedness, or creativity. The individual's eccentric behavior is perceived to be the outward expression of his or her unique intelligence or creative impulse. In this vein, the eccentric's habits are incomprehensible not because they are illogical or the result of madness, but because they stem from a mind so original that it cannot be conformed to societal norms.

check out my blog

Kaizen · May 21st, 2008

how does it work in gran turismo 4?

doubling the res still leaves gt4 looking pretty rough :/

lightchris · May 21st, 2008

Quote:

Originally Posted by John Aiton

how does it work in gran turismo 4?

doubling the res still leaves gt4 looking pretty rough :/

For me GT4 mostly suffers from a sort of blurry image, just like some other games (for example Grandia 3 or Dragon Quest 8). For these games I find it better to use a higher internal resolution because it sharpens the whole image a bit.

Generally with 4x MSAA the image quality concerning the polygon edges is a bit better than using a quadrupled internal res. On the other hand a higher internal res treats the whole image while MSAA works on polygon edges exclusively.
Other than in PC games where MSAA is usually much faster than using a higher resolution, the difference doesn't seem to bit that high in PCSX2.

To put it shortly: Imo it depends on the game whether it is better to use MSAA or a higher internal resolution.

I've taken a few screenshots of Grandia 3 in order to demonstrate what I stated. From left to right it is: 1280*960 without AA / 1280*960 with 4xAA / 2560*1920 (without AA). Especially pay attention to the pillars on the left.

Attached Images

	g3_1280_1xaa.jpg (343.8 KB, 333 views)
	g3_1280_4xaa.jpg (342.3 KB, 323 views)
	g3_2560_1xaa.jpg (364.2 KB, 324 views)

**RPGW1ZaRD** · May 21st, 2008

I'm pretty sure it should work to force AA from cpanel using driver 174.74 or newer using the new AA force method setting "override any application settings". At least pre this driver lots of pc games wouldn't use AA if forced it from cpanel so RivaTuner or nHancer etc was required but with driver version 174.74 or newer it works with all pc games I've tested and I'm pretty that goes for pcsx2 too but I haven't tested yet.

lightchris · May 21st, 2008

Quote:

Originally Posted by RPGW1ZaRD

I'm pretty sure it should work to force AA from cpanel using driver 174.74 or newer using the new AA force method setting "override any application settings". At least pre this driver lots of pc games wouldn't use AA if forced it from cpanel so RivaTuner or nHancer etc was required but with driver version 174.74 or newer it works with all pc games I've tested and I'm pretty that goes for pcsx2 too but I haven't tested yet.

Nope, it doesn't work that way in PCSX2.

NexXxus · May 21st, 2008

it works only with the compatiblity mode so far.

btw: i added pics in the first post.

__________________

My System: C2D E6700 @3.4ghz | Asus P5W DH Deluxe | 4GB DDR2 800 | eVGA Geforce GTX 260 55nm SC-Edition
Tutorial: Hardware Antialiasing in PCSX2 (DX9 only)

Quake3k · May 21st, 2008

For me it seems like not working at all i don`t use nHancer tought i did use nvidias own profile editor that have alot more options. first are with profile and the second picture is without profile also the rest of the picture are with profile (aa++++)

Attached Images

	gsdx_20080522001539_thumb.jpg (229.6 KB, 81 views)
	gsdx_20080522001704_thumb.jpg (235.1 KB, 63 views)
	gsdx_20080522000639_thumb.jpg (249.4 KB, 42 views)
	gsdx_20080522000645_thumb.jpg (245.7 KB, 51 views)
	gsdx_20080522000840_thumb.jpg (182.0 KB, 75 views)
	Capturepcsx2.JPG (43.3 KB, 69 views)

NexXxus · May 21st, 2008

Quote:

Originally Posted by Quake3k

For me it seems like not working at all

yea because you don't use the compatiblity mode...

__________________

My System: C2D E6700 @3.4ghz | Asus P5W DH Deluxe | 4GB DDR2 800 | eVGA Geforce GTX 260 55nm SC-Edition
Tutorial: Hardware Antialiasing in PCSX2 (DX9 only)

Nightmare85 · May 21st, 2008

OK, just for Quake3k:

BTW: Do you really like to have fat fighters?? I always use nvidia's scalling...

Attached Images

comp.JPG (138.8 KB, 144 views)

__________________
Greets---N--i--g--h--t--m a--r--e

Intel Core 2 Duo E8400 @ 3,2 GHZ (1,184 V) with Noctua NH12F, XFX GeForce 8800 GTS G92, Kingston HyperX KHX6400D2LLK2/2G (4x 1 GB DDR2-800 CL 4-4-4-12), Asus P5E, Creative X-Fi Xtreme Gamer Fatal1ty Pro with Logitech X-540, Tagan TG580-U22 2force 580 Watt, Western Digital WD6400AAKS + 250 GB external HDD + 80 GB iPod, LG GSA-H10NBB, Logitech G9, Logitech G15, Logitech Cordless Rumblepad 2, Logitech Rumblepad 2 refresh, Cooler Master Cavalier (Window-Kit), 22" TFT monitor, WinXP Pro SP3

Quake3k · May 21st, 2008

Still cant see the diffrence with compatibilty mode on also..but guess it are a real bad game to test on it seems like

anyway first picture with second without

Attached Images

	gsdx_20080522004721_thumb.jpg (233.1 KB, 90 views)
	gsdx_20080522004922_thumb.jpg (234.9 KB, 87 views)

NexXxus · May 21st, 2008

some more shots:

Kingdom Hearts:

the quality and framerate are in fact better when using 4X AA

first one with 4XAA, second with 3360x2100 internal res, no AA

Attached Images

	kh_4XAA.jpg (347.4 KB, 368 views)
	kh_3360_2100_noAA.jpg (353.0 KB, 346 views)

__________________

My System: C2D E6700 @3.4ghz | Asus P5W DH Deluxe | 4GB DDR2 800 | eVGA Geforce GTX 260 55nm SC-Edition
Tutorial: Hardware Antialiasing in PCSX2 (DX9 only)

Last edited by NexXxus; May 22nd, 2008 at 00:17.

May 21st, 2008	#1 (permalink)
NexXxus it'se miku! Join Date: Jan 2006 Location: Cologne, Germany Posts: 3,604	Tutorial: Using Hardware Antialiasing in PCSX2 ! Now i finally found out how it works It only works with GSdx in DX9 Fullscreen mode. It does not work with ZeroGS, GSdx windowed or DX10 mode. It may work with ATI cards, but i don't know a tool for that. here is a small tutorial for Nvidia cards: 1.) Make sure you're using the latest Nvidia Forceware driver (it may work with beta drivers too, but i didn't test it.) 2.) Download nHancer and install it. 3.) Get the latest GSdx version, link in my signature 4.) run nHancer 5.) enable options/Allow override of predefined settings, 6.) create a new profile, name it PCSX2. 7.) select the PCSX2 profile and add all pcsx2 exe's you're currently using. 8.) under the enhancements tab, select an Anti-Aliasing mode, i used Multisampling/4X that looks fine. be warned that an higher antialiasing mode can slow down a game from 60 to 5fps! 9.) go to the compatiblity tab and check Anti-Aliasing compatiblity, select the "Stalker" or "Vengard" Compatiblity mode. 10.) run pcsx2 and configure GSdx 11.) under resolution,select your native display resolution (example: for 22" widescreens its 1680x1050, 19" 4/3 would be 1280x1024, you can select lower resolutions like 1024x768 or 800x600, but you must use the same resolution for the internal d3d resolution!) 12.) The D3D internal res have to match with the fullscreen resolution, otherwise it will not work. If you selected 1680x1050, then type 1680x1050, 1280x1024 then 1280x1024... and so on... 13.) run a game and hope it'll work. Important! If you notice crashes and instability problems of your System use "Vengard" as Compatiblity mode instead Stalker! i tested it with FFX-2 and it works fine. FFX works fine too, but there is one thin horizontal line at the lower screen in movies. here some compare shots: http://img3.imagebanana.com/img/sy6mwqm0/compare1.jpg http://img3.imagebanana.com/img/25ii0586/compare2.jpg http://img3.imagebanana.com/img/lr5ktec6/compare3.jpg http://img3.imagebanana.com/img/0rv2849d/compare4.jpg FFX http://img3.imagebanana.com/img/mo7seeci/FFX_1_8XAA.jpg http://img3.imagebanana.com/img/qa2e5j0w/FFX_1_noAA.jpg http://img3.imagebanana.com/img/ffg0j91/FFX_2_8XAA.jpg http://img3.imagebanana.com/img/k4yh8iso/FFX_2_noAA.jpg http://img3.imagebanana.com/img/l961af2t/FFX_3_8XAA.jpg http://img3.imagebanana.com/img/tjzs3v7i/FFX_3_noAA.jpg FFX-2 http://img3.imagebanana.com/img/kj07...FX2_1_8XAA.jpg http://img3.imagebanana.com/img/vsf80z1/FFX2_1_noAA.jpg http://img3.imagebanana.com/img/0fl0...FX2_2_8XAA.jpg http://img3.imagebanana.com/img/o7mx...FX2_2_noAA.jpg http://img3.imagebanana.com/img/e39wfqb/FFX2_3_8XAA.jpg http://img3.imagebanana.com/img/cuuji0m/FFX2_3_noAA.jpg http://img3.imagebanana.com/img/l5kxmxl/FFX2_4_8XAA.jpg http://img3.imagebanana.com/img/0dlu4th/FFX2_4_noAA.jpg http://img3.imagebanana.com/img/crmenx/FFX2_5_8XAA.jpg http://img3.imagebanana.com/img/olvn...FX2_5_noAA.jpg http://img3.imagebanana.com/img/tg6zz1k/FFX2_6_8XAA.jpg http://img3.imagebanana.com/img/u1kzwzh/FFX2_6_noAA.jpg __________________ My System: C2D E6700 @3.4ghz \| Asus P5W DH Deluxe \| 4GB DDR2 800 \| eVGA Geforce GTX 260 55nm SC-Edition Tutorial: Hardware Antialiasing in PCSX2 (DX9 only) Last edited by NexXxus; July 18th, 2009 at 03:35.

Thread Tools
Show Printable Version Email this Page
Display Modes
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode

May 21st, 2008	#3 (permalink)
Nightmare85 Registrierter Benutzer Join Date: Jun 2006 Location: Germany Posts: 205	Godlike! __________________ Greets---N--i--g--h--t--m a--r--e Intel Core 2 Duo E8400 @ 3,2 GHZ (1,184 V) with Noctua NH12F, XFX GeForce 8800 GTS G92, Kingston HyperX KHX6400D2LLK2/2G (4x 1 GB DDR2-800 CL 4-4-4-12), Asus P5E, Creative X-Fi Xtreme Gamer Fatal1ty Pro with Logitech X-540, Tagan TG580-U22 2force 580 Watt, Western Digital WD6400AAKS + 250 GB external HDD + 80 GB iPod, LG GSA-H10NBB, Logitech G9, Logitech G15, Logitech Cordless Rumblepad 2, Logitech Rumblepad 2 refresh, Cooler Master Cavalier (Window-Kit), 22" TFT monitor, WinXP Pro SP3

May 21st, 2008	#4 (permalink)
Mkilbride2588 The Pest Join Date: Oct 2006 Location: Earth Posts: 1,801	Wow, we already have enough trouble running these games at super high resolution and now AA is introduced...we're going to need 2-3 future generation cards to do 16x AA Super-Sampling...even though, with that enabled, Native would be godlike, but imagine like 1920 x 1200 @ 16x AA, with Super-Sampling and Trin filtering...FFX would look next Gen :P __________________ PC configuration Q6600 @ 3.4GHZ Stable,GeForce 8800 GT 512 MB GDDR3(Super-clocked) ,4GB PC8000(1000MHZ) RAM @ 950MHZ(5-5-5-15)(Waiting to tweak them eventually),Windows XP SP2 Professional(Vista 64 bit, Dual Boot),750GB 7200 RPM, 32 MB Cache Hard-drive(SATAII),24'' LCD( I know, sorry CRT'ers) HD 1080pi, DVI connected, 1920 x 1200 @ 60HZ),P35-DS3L Revision 2.0 @ 1.49V http://tinyurl.com/2zzzsr Use the Guide above to get PCSX2 to run properly. Has all you need to know to run PCSX2. Having trouble with a game? Check here: http://tinyurl.com/2cuzhx

May 21st, 2008	#5 (permalink)
NexXxus it'se miku! Join Date: Jan 2006 Location: Cologne, Germany Posts: 3,604	it looks a bit better than doubled internal res like 3360x2100. i can post screens later. __________________ My System: C2D E6700 @3.4ghz \| Asus P5W DH Deluxe \| 4GB DDR2 800 \| eVGA Geforce GTX 260 55nm SC-Edition Tutorial: Hardware Antialiasing in PCSX2 (DX9 only)

May 21st, 2008	#6 (permalink)
lightchris Emu Addict Join Date: Jan 2004 Location: Germany Posts: 175	Yep, I already noticed this way to use AA in PCSX2 some while ago. I can confirm that it works, at least with graphics cards of the GeForce 8xxx/9xxx series. Sadly it's barely faster than increasing the internal rendering resolution in the games i tried. So it's relatively useless to me. Btw. I remember some other compatibility settings than "STALKER" were also working, giving slightly different results in image quality or speed.

May 21st, 2008	#9 (permalink)
Mkilbride2588 The Pest Join Date: Oct 2006 Location: Earth Posts: 1,801	Yeah...I was hoping AA would help alot more...but it's not really at all. __________________ PC configuration Q6600 @ 3.4GHZ Stable,GeForce 8800 GT 512 MB GDDR3(Super-clocked) ,4GB PC8000(1000MHZ) RAM @ 950MHZ(5-5-5-15)(Waiting to tweak them eventually),Windows XP SP2 Professional(Vista 64 bit, Dual Boot),750GB 7200 RPM, 32 MB Cache Hard-drive(SATAII),24'' LCD( I know, sorry CRT'ers) HD 1080pi, DVI connected, 1920 x 1200 @ 60HZ),P35-DS3L Revision 2.0 @ 1.49V http://tinyurl.com/2zzzsr Use the Guide above to get PCSX2 to run properly. Has all you need to know to run PCSX2. Having trouble with a game? Check here: http://tinyurl.com/2cuzhx

May 21st, 2008	#11 (permalink)
Kaizen Banned Join Date: Nov 2007 Location: Sucking your penis Posts: 2,717	how does it work in gran turismo 4? doubling the res still leaves gt4 looking pretty rough :/

May 21st, 2008	#13 (permalink)
RPGW1ZaRD PCSX2 & O/C Addict Join Date: Mar 2006 Location: My Computer Posts: 2,840	I'm pretty sure it should work to force AA from cpanel using driver 174.74 or newer using the new AA force method setting "override any application settings". At least pre this driver lots of pc games wouldn't use AA if forced it from cpanel so RivaTuner or nHancer etc was required but with driver version 174.74 or newer it works with all pc games I've tested and I'm pretty that goes for pcsx2 too but I haven't tested yet.

May 21st, 2008	#15 (permalink)
NexXxus it'se miku! Join Date: Jan 2006 Location: Cologne, Germany Posts: 3,604	it works only with the compatiblity mode so far. btw: i added pics in the first post. __________________ My System: C2D E6700 @3.4ghz \| Asus P5W DH Deluxe \| 4GB DDR2 800 \| eVGA Geforce GTX 260 55nm SC-Edition Tutorial: Hardware Antialiasing in PCSX2 (DX9 only)