1. RICE UNIVERSITY Flexible wireless communication architectures Sridhar Rajagopal Department of Electrical and Computer Engineering Rice University, Houston TX March 31, 2003 This work has been supported in part by Nokia, TI, TATP and NSF

2. RICE UNIVERSITY Future wireless devices :  High data rate mobile devices with multimedia  Multiple antennas w/ complex algorithms, GOPs of computation  Area-Time-Power constraints  Seamless connection across environments and standards  Use the fastest and cheapest available service Bluetooth/ Home Networks Wireless Cellular Wireless LAN

3. RICE UNIVERSITY Aim of the talk Design me

4. RICE UNIVERSITY Trends FLEXIBILITY

5. RICE UNIVERSITY Change in flexibility requirements Physical Layer MAC Layer Network Layer Application Layer No change (already flexible) Maximum change (needs to support multiple environments, algorithms and standards)

6. RICE UNIVERSITY Architecture trade-offs Past : more DSP + less ASIC, Current : less DSP + more ASIC Reason: need less flexibility OR DSPs not powerful enough? Can’t we build better DSPs? How much flexibility do we need? ASICs Intermediate Programmable Area-Time-Power benefits Flexibility Time-to-market Software updates

7. RICE UNIVERSITY What is the right architecture? ASICs not good:  Need much more flexibility  Multiple complex algorithms and multiple environments  Cannot keep adding co-processors DSPs not good either:  1 Mbps with 100 MHz processor  100 cycles available per bit (GOPs)  Power : bigger color displays and more complex algorithms  Only ~100 mW for baseband Need a methodology to explore flexibility-architecture tradeoffs

8. RICE UNIVERSITY My contributions Algorithms: Parallel, fixed point algorithms for multiuser estimation and detection Architectures: Dynamic truncation in ASICs using on-line arithmetic Processors: Scalable Wireless Application-specific Processors (SWAPs) Design methodology to explore flexibility vs. architecture tradeoffs

9. RICE UNIVERSITY Problems with current DSPs  Current DSPs  Not enough functional units (FUs) for GOPs of computation  Need 100’s of FUs  Not low power enough!!  Cannot extend to more FUs  Limited Instruction Level Parallelism (ILP)  Limited Subword Parallelism (such as MMX)  Cannot support more registers (area,ports)  Compilers: difficult to find ILP as FUs increase

10. RICE UNIVERSITY Solution: SWAPs  Exploit data parallelism (DP)  Available in many wireless algorithms  This is what ASICs do!!  Example: int i,a[N],b[N],c[N]; // 32 bits short int d[K],e[K],f[K]; // 16 bits packed for (i = 1; i<= 1024; ++i) { a[i] = b[i] + c[i]; d[i] = e[i] + f[i]; } ILP DP Subword

11. RICE UNIVERSITY SWAPs: stream processors for wireless Kernel Viterbi decoding Stream Input Data Output Data Correlator channel estimation received signal Matched filter Interference Cancellation Decoded bits  Kernels (computation) and streams (communication)  Operations on kernels use local data  Streams expose data parallelism  Imagine stream processor at Stanford

12. RICE UNIVERSITY DSP vs. SWAPs + + + * * * Internal Memory ILP Stream Register File (SRF) DSP (1 cluster) + + + * * * + + + * * * + + + * * * + + + * * * … ILP DP SWAPs (max. clusters All clusters same & do same operations)

13. RICE UNIVERSITY Arithmetic clusters  FUs (+,*,/)  Scratch-pad (Sp)  Indexed accesses  Comm. unit (CU)  Intercluster comm.  Distributed reg. Files  more FUs Intercluster Network From/To SRF Cross Point Local Register File CU + + + * * / + / + + + * * / + / Sp SRF

14. RICE UNIVERSITY SWAPs vs. Imagine trade-offs  Imagine – Stanford  Optimized for media processing  Floating point with 8 clusters  3 adders, 2 multipliers, 1 divider in each  Architecture simulator tool  Vary number of clusters, functional units, registers ….  SWAPs – Rice  Optimized for wireless communications  Minimized access to data memory  Fixed point with clusters adapting to available DP  Functional units adapting to available ILP

15. RICE UNIVERSITY SWAPs vs. DSPs trade-offs  Same internal memory size as DSPs  Dependent on application, not architecture  Needs more area to support more functional units  Area is less of a constraint than power  Varying levels of DP in applications  Needs reconfiguration!!  Need to turn off unused clusters (and FUs)  More parallelism  lower clock frequency  lower voltage  low power (  CV 2 f + leakage) in spite of larger area

16. RICE UNIVERSITY Design methodology Chain of receiver algorithms Low “complexity”, parallel, fixed point High level language implementation Modular programmable architecture design ASIC design FPGA, customized, reconfigurable, heterogeneous designs DSP, SWAPs learn H-SWAPs learn Algorithm-specific Architecture exploration Flexibility- performance tradeoffs

17. RICE UNIVERSITY Physical layer of wireless receivers Antenna Channel estimation DetectionDecoding Higher (MAC/Network/ OS) Layers RF Front-end Baseband processing Receiver more complex than transmitter

18. RICE UNIVERSITY Algorithms for  Multiple antenna systems (MIMO systems)  Complexity exponential with transmit * receive antennas  Wide range of extremely complex algorithms  Optimal depends on fading, mobility, bandwidth, antennas  GOPs of computations  Estimation: Linear MMSE, blind, conjugate gradient….  Detection: FFT, (blind) interference cancellation….  Decoding: Viterbi, Turbo, LDPC….  Implement ALL of them AND the NEXT one in line  Use for the best for the situation Example for concept demonstration: Viterbi decoding

19. RICE UNIVERSITY Parallel Viterbi Decoding  1. Add-Compare-Select (ACS) : trellis interconnect  Parallelism depends on constraint length (#states)  2. Conventional Traceback  Sequential (No DP)  Difficult to implement in parallel architecture  Use Register Exchange (RE)  parallel solution

20. RICE UNIVERSITY Re-ordering for parallel Viterbi a. Trellis X(0) X(1) X(2) X(3) X(4) X(5) X(6) X(7) X(8) X(9) X(10) X(11) X(12) X(13) X(14) X(15) X(0) X(1) X(2) X(3) X(4) X(5) X(6) X(7) X(8) X(9) X(10) X(11) X(12) X(13) X(14) X(15) X(0) X(2) X(4) X(6) X(8) X(10) X(12) X(14) X(1) X(3) X(5) X(7) X(9) X(11) X(13) X(15) X(0) X(1) X(2) X(3) X(4) X(5) X(6) X(7) X(8) X(9) X(10) X(11) X(12) X(13) X(14) X(15) b. Shuffled Trellis Exploiting Viterbi DP in SWAPs:  Re-order ACS, RE  Overhead

21. RICE UNIVERSITY SWAP: Algorithms + Architecture Algorithm design for parallelism Architecture design?

22. RICE UNIVERSITY SWAP design  Decide how many clusters  Exploit DP  Decide what to put within each cluster  Maximize ILP with high functional unit efficiency  Search design space with “explore” tool  See how it meets time-area-power constraints + ? * * + * * + * * + * * … ILP DP ???

23. RICE UNIVERSITY Inside a SWAP cluster: EXPLORE Auto-exploration of adders and multipliers for “ACS" (Adder FU%, Multiplier FU%)

24. RICE UNIVERSITY “Explore” tool benefits  Instruction count vs. functional unit efficiency  What goes inside each cluster  Explore all algorithms  turn off functional units not in use for given kernel  Design customized application-specific units  Better performance with increased FU utilization Algorithm 1 : 3 adders, 3 multipliers, 32 clusters Algorithm 2 : 4 adders, 1 multiplier, 64 clusters Architecture: 4 adders, 3 multipliers, 64 clusters

25. RICE UNIVERSITY Viterbi reconfiguration Packet 1 Constraint length 7 (16 clusters) Packet 2 Constraint length 9 (64 clusters) Packet 3 Constraint length 5 (4 clusters) DPCan be turned OFF

26. RICE UNIVERSITY Reconfiguration : 1 : Data transfer Move data to appropriate clusters via comm units Significant performance loss, additional SRF memory required Can turn off SRF too! SRF Clusters CU

27. RICE UNIVERSITY Reconfiguration : 2: Conditional streams Sp Transfer data via comm unit (CU) and scratchpad (Sp) Minimal loss in performance Cannot turn off SRF, comm unit, scratchpad in clusters

28. RICE UNIVERSITY Reconfiguration : 3 : Multiplexed buffers Use mux-demux buffers Minimal loss in performance Can turn off clusters entirely – more power savings

29. RICE UNIVERSITY 64-bit Packet 1 Rate ½ K = 7 Packet 2 K = 9 Packet 3 K = 5 Kernels (Computation) No Data Memory accesses Execution Time (cycles) ClustersMemory

30. RICE UNIVERSITY Viterbi decoding: rate 1/2 at 128 Kbps = 10 MHz 110100 1 10 100 1000 Number of clusters Frequency needed to attain real-time (in MHz) K = 9 K = 7 K = 5 Static architecture SWAPs DSP Ideal C64x (w/o co-proc) needs ~200 MHz for real-time

31. RICE UNIVERSITY SWAPs : Salient features  1-2 orders of magnitude better than 1 processor DSP  Any constraint length  10 MHz at 128 Kbps  Same code for all constraint lengths  no need to re-compile or load another code  as long as parallelism/cluster ratio is constant  Power savings due to dynamic cluster scaling

32. RICE UNIVERSITY Expected SWAP power consumption  64 clusters and 1 multiplier per cluster:  0.13 micron, 1.2 V  Peak Active Power: ~9 mW at 1 MHz  Area: ~53.7 mm 2  10 MHz, 128 Kbps with reconfiguration *Exploring the VLSI Scalability of Stream Processors, Brucek Khailany et al, Proceedings of the Ninth Symposium on High Performance Computer Architecture, February 8-12, 2003, Anaheim, California, USA, pp. 153-164 010203040506070 0 10 20 30 40 50 60 70 80 90 Active Clusters (max 64) Power (in mW) ViterbiClusters usedPeak Power K = 964~90 mW K = 716~28.57 mW K = 54~13.8 mW overhead0~8.1 mW

33. RICE UNIVERSITY Flexibility vs. performance  Suitable for mobile devices?  SWAPs: Real-time at ~10-100 mW  Maybe ; but can we do better?  ASICs : Real-time at ~10-100  W  No special customization for the application  No application-specific units  Generic inter-cluster communication network  Overhead for extracting parallelism  SWAPs suitable for base-stations?  Why not? – power is not a primary constraint!

34. RICE UNIVERSITY Multiuser Estimation-Detection+Decoding Real-time target : 128 Kbps per user Ideal C64x (w/o co-proc) needs ~15 GHz for real-time

35. RICE UNIVERSITY Expected SWAP power : base-station  32 user base-station with 3 X’s per cluster and 64 clusters:  0.13 micron, 1.2 V  Peak Active Power: ~18.19 mW for 1 MHz (increased *)  Area: ~93.4 mm 2  Total Peak Base-station power consumption:  ~18.19 W at 1 GHz for 32 users at 128 Kbps/user

36. RICE UNIVERSITY Current research  SWAPs : Completely flexible and general  How do we trade-off flexibility for better performance?  Handset SWAPs (H-SWAPs)

37. RICE UNIVERSITY Let’s look at ASICs *VITURBO: A reconfigurable architecture for Viterbi and Turbo decoding, M. Vaya, J. R. Cavallaro, IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), April 2003, Hong Kong 128 KHz * (1 bit /cycle) DSP SWAP ASIC/ FPGA DP Task Pipelining Dedicated interconnect 10 MHz (~1 bit /100 cycles) 200 MHz (~1 bit /2000 cycles) Execution time

38. RICE UNIVERSITY Handset SWAPs: H-SWAPs  Trade Data Parallelism for Task Pipelining  Design SWAPlets and customize each SWAPlet SWAPs (max. clusters and reconfigure) + + + * + + + * + + + * + + + * Limited DP SWAPlet (limit clusters) + + + * + + + * + + + * + + + * Limited DP + + * + + * + + * + + * Limited DP + + + + + + + + Limited DP H-SWAPs (collection of customized SWAPlets)

39. RICE UNIVERSITY H-SWAPs: Viterbi decoding  Survivor management – serial  Finding parallel solution for SWAPs – expensive  > 50% of execution time : overhead  Serial solution now possible with H-SWAPs  Better performance with less flexibility!! A C S + A C S + A C S + A C S + Limited DP TBUTBU H-SWAPs for Viterbi decoding ACS unit Traceback unit

40. RICE UNIVERSITY H-SWAPs: Potential advantages DSP (RE) SWAP ASIC/FPGA – Real-time performance DP Task Pipelining Dedicated interconnect DSP (RE) H-SWAP Partial DP + Task Pipelining Application-specific units ASIC/FPGA – Real-time performance Dedicated interconnect H-SWAPsSWAPs Execution time

41. RICE UNIVERSITY Current research  Task vs. data parallelism tradeoffs  Evaluation of specialized inter-cluster communication  Integrating specialized arithmetic units (ACS, on-line)  Learning to migrate from H-SWAPs to SWAPs  Scale to future systems!!

42. RICE UNIVERSITY Future research: efficient algorithms

43. RICE UNIVERSITY Future research: architectures Generalized framework and tools for evaluating algorithm- architecture and area-time-power-flexibility trade-offs Some other potential applications  Image processing:  Cameras : variety of compression algorithms  Biomedical applications:  Hearing aids: DSP running on body heat *  Sensor networks  Compression of data before transmission *Quote: Gene Frantz, TI Fellow

44. RICE UNIVERSITY Conclusions  Need flexible architectures for future wireless devices  Higher data rates, lower power, more complex algorithms  Design methodology (SWAPs, H-SWAPs, ASICs)  Flexibility vs. performance trade-offs  Blurs distinction between ASICs and programmable solutions  Also need parallel, low precision algorithms for efficient mapping  Inter-disciplinary research:  Computer architecture, VLSI, wireless communications, computer arithmetic, compilers