Yes you can just remove it, but you sould really find out what is causing it. A core file is created when one of your programs crashes, Linux dumps what is currently in memory to a file called core in the directory that the program was running from.
If you are getting core's then you have a program that is crashing and you should find out what program that is and fix the problem.
