Use "just" to express something that was done lightly and without thinking about it very much. In the example above, the coworker ignored the speaker. He didn't think about it or plan it, but just did it. The speaker could also say:

He just kept on working and didn't even look at me.