Yes, the seat matters
There are advantages and disadvantages to every seat at the table.
1st base. Disadvantage is that you need to act immediately, so you might give off a counter tell if you pause on an obvious hand. Of course, this could play into some acts, so may or may not be a disadvantage. You could also get squeezed in and not be able to leave as quickly. Advantages are that you have a clear line of sight to the discard tray, and the rest of the table, so you don't need to do the tennis spectator thing where you turn your head from side to side as cards are dealt. You may also have a better view of the pit, which can be important. You also have more room on the table that is not easily reachable by another player so you don't have to worry as much about someone grabbing chips, etc.
Center field. Disadvantages are the opposite of the advantages listed for first base. Advantages include the ability to quickly leave the table, potentially better view of the pit and other tables, etc. This range of seats also makes it more likely that you will naturally get an empty spot right next to you in case you suddenly need to spread to two or three spots.
Third base. Marginally better penetration for playing decisions, which won't really matter much unless you are playing a deeply dealt single deck game. Some of the same advantage of first base as far as view of the table and pit. Disadvantage is increased scrutiny by other players and also the pit.
If you are hole carding, or doing anything other than counting, then there are other considerations that are much more important than those listed above.