Linux to Mac

Automating FTP on the Mac

- 2009.03.04 - Tip Jar

Popularity:

There is no shortage of GUI FTP programs, but kicking it old school on the command line allows you to easily automate uploads and downloads. The best part is, there is nothing to install. Everything you need waits patiently behind the warm glow of a Terminal session.

The Mac Command Line FTP Program

The default command line FTP program in OS X 10.5 resides at /usr/bin/ftp

By all outward appearances and behavior, the Mac FTP program is the standard BSD version. The man page is the standard BSD main page and contains a wealth of useful information.

A typical command line FTP session is interactive and goes something like this:

login to an FTP server
issue commands (ls (list), get (download), put (upload))
quit

If you have a repetitive FTP task, the fun quickly fades into a mind numbing exercise. This is where FTP automation shines.

The Magical .netrc File

What makes FTP automation possible is a magical, little known file called .netrc. The .netrc file is a plain text file that is hidden (the file name starts with a period) and lives in the root of your home directory. The .netrc file allows FTP to perform automatic logins to FTP servers based on the name.

The .netrc is not created by default. You have to create it manually. To create an empty .netrc file, open a Terminal and use the following commands:

touch .netrc
chmod 700 .netrc

It is critical that you issue the chmod command to set the permissions so that only the owner of the file can view it. If the permissions are not set correctly, the FTP client will assume it has been compromised and will refuse to use it.

Inside the .netrc, you define a block of settings for each FTP server you use, including the machine name, the login ID, and the password. Here is a typical block for a mythical FTP server:

machine myftpserver.com
   login myuser
   password mypassword

There are additional settings that can be included. Check the FTP man page for more. You can test your settings by typing "ftp myftpserver.com" at a Terminal prompt, and it should automatically login. Note that you can store multiple FTP server logins in the .netrc file.

Sending FTP Commands from a BASH Shell Script

Once logins are automated, the final piece of the puzzle is to script a set of FTP commands. The following example uses an advanced BASH shell scripting technique called a "here" document to group the FTP commands to be sent to the server.

#!/bin/bash
/usr/bin/ftp -d myftpserver.com << ftpEOF
   prompt
   put "*.html"
   quit
ftpEOF

The FTP command is issued with the -d flag (debug mode) to make it more verbose. That makes any kind of error more obvious. The connection is made to myftpserver.com using the ID and password from the .netrc file. Once the connection is made, the rest of the commands are issued one at a time until the end of the "here" document at the second "ftpEOF". Note that any valid FTP commands can be sent. In the example, the prompt command tells FTP not to prompt for multiple file operations, then the put uploads all files with an .html extension. If you want to go the extra mile, you can extend the shell script and do things like reconnect to the FTP server to verify the file sizes of your uploads.

While there are several ways you can automate FTP, the nice thing about this method is that it is portable to Linux or any other Unix system.

Join us on Facebook!, follow us on Twitter, use our Google+ page, or read our RSS news feed

Keith Winston is a recent Mac convert after five years of Linux on the desktop. He also writes for Linux.com and created CommandLineMac to focus on the Unix-y power of the Mac. If you find Keith's articles helpful, please consider making a donation to his tip jar.

Recent Linux to Mac Columns

Apple's launchd Is Anti-Unix, 2010.07.13. Unix prefers programs that do one thing very well, but Apple's launchd takes the opposite approach.
Automount OS X Home Directories Using OpenLDAP and Linux, 2009.09.28. It's possible to get an OS X Mac to automatically mount a Linux server using OpenLDAP. The tricky part is finding all the steps needed to make it work.
Introduction to Autofs in Mac OS X, 2009.07.01. "Autofs is often used in enterprise environments to set up network-based home directories and other network mounts for users at login."
More in the Linux to Mac index.

Links for the Day

Mac of the Day: Lisa, introduced 1983.01.19. The ancestor of the Macintosh had a mouse, a graphical interface, and a $10,000 price tag.
May 21 in LEM history: 99: Not censorship - 01: USB and FireWire drives - 02: Hooked by a PowerBook - Printer sharing for Mac OS X - 04: Less frequent OS X uprades: Good or bad? - 07: I won't get an iPhone this year - Can 262,144 colors be considered 'millions'? - Most durable 'Book - 3 GB in a Mac mini? - 08: Quadra a great server for vintage Mac network
Support Low End Mac

Recent Deals

About LEM Support Usage Privacy Contact

Low End Mac is an independent publication and has not been authorized, sponsored, or otherwise approved by Apple Inc. Entire Low End Mac website copyright ©1997-2012 by Cobweb Publishing, Inc. unless otherwise noted. All rights reserved. Low End Mac, LowEndMac, and lowendmac.com are trademarks of Cobweb Publishing Inc. Apple, the Apple logo, Macintosh, iPad iPhone, iMac, iPod, MacBook, MagSafe, Mac Pro, Apple TV, and AirPort are registered trademarks of Apple Inc. Additional company and product names may be trademarks or registered trademarks and are hereby acknowledged.
Advice is presented in good faith, but what works for one may not work for all. Please report errors to .
LINKS: We allow and encourage links to any public page as long as the linked page does not appear within a frame that prevents bookmarking it.
Email may be published at our discretion unless marked "not for publication"; email addresses will not be published without permission, and we will encrypt them in hopes of avoiding spammers. Letters may be edited for length, context, and to match house style.
PRIVACY: We don't collect personal information unless you explicitly provide it. For more details, see our Terms of Use.

Custom Search

Follow Low End Mac on Twitter
Join Low End Mac on Facebook

Low End Mac Reader Specials

Macsales.com SuperSpeed SSDs from $58. Transform your Mac with an SSD Solution of up to 960GB! You won't believe it's the same machine! Once you experience an OWC SSD, no going back! - Macsales.com

Don't install Parallels to play poker online! Macpokeronline.com will show you how to download and play Poker on a Mac natively on your Mac in just minutes.