Bài giảng Computer Organization and Architecture: Chapter 18

Parallel Processing thuộc Chapter 18 của "Bài giảng Computer Organization and Architecture" sẽ giới thiệu tới các bạn một số vấn đề cơ bản về Multiple Processor Organization; Single Instruction, Single Data Stream - SISD; Single Instruction, Multiple Data Stream - SIMD; Multiple Instruction, Single Data Stream - MISD;...
Nội dung trích xuất từ tài liệu:
Bài giảng Computer Organization and Architecture: Chapter 18William StallingsComputer Organizationand Architecture6th EditionChapter 18Parallel ProcessingMultiple Processor Organization• Singleinstruction,singledatastreamSISD• Singleinstruction,multipledatastreamSIMD• Multipleinstruction,singledatastreamMISD• Multipleinstruction,multipledatastreamMIMDSingle Instruction, Single Data Stream - SISD• Singleprocessor• Singleinstructionstream• Datastoredinsinglememory• UniprocessorSingle Instruction, Multiple Data Stream - SIMD• Singlemachineinstruction• Controlssimultaneousexecution• Numberofprocessingelements• Lockstepbasis• Eachprocessingelementhasassociateddata memory• Eachinstructionexecutedondifferentsetof databydifferentprocessors• VectorandarrayprocessorsMultiple Instruction, Single Data Stream - MISD• Sequenceofdata• Transmittedtosetofprocessors• Eachprocessorexecutesdifferentinstruction sequence• NeverbeenimplementedMultiple Instruction, Multiple Data Stream- MIMD• Setofprocessors• Simultaneouslyexecutedifferentinstruction sequences• Differentsetsofdata• SMPs,clustersandNUMAsystemsTaxonomy of Parallel Processor ArchitecturesMIMD - Overview• Generalpurposeprocessors• Eachcanprocessallinstructionsnecessary• Furtherclassifiedbymethodofprocessor communicationTightly Coupled - SMP• Processorssharememory• Communicateviathatsharedmemory• SymmetricMultiprocessor(SMP) —Sharesinglememoryorpool —Sharedbustoaccessmemory —Memoryaccesstimetogivenareaofmemoryis approximatelythesameforeachprocessorTightly Coupled - NUMA• Nonuniformmemoryaccess• Accesstimestodifferentregionsofmemroy maydifferLoosely Coupled - Clusters• Collectionofindependentuniprocessorsor SMPs• Interconnectedtoformacluster• Communicationviafixedpathornetwork connectionsParallel Organizations - SISDParallel Organizations - SIMDParallel Organizations - MIMD Shared MemoryParallel Organizations - MIMDDistributed MemorySymmetric Multiprocessors• Astandalonecomputerwiththefollowing characteristics — Twoormoresimilarprocessorsofcomparablecapacity — ProcessorssharesamememoryandI/O — Processorsareconnectedbyabusorotherinternalconnection — Memoryaccesstimeisapproximatelythesameforeach processor — AllprocessorsshareaccesstoI/O – Eitherthroughsamechannelsordifferentchannelsgivingpathsto samedevices — Allprocessorscanperformthesamefunctions(hence symmetric) — Systemcontrolledbyintegratedoperatingsystem – providinginteractionbetweenprocessors – Interactionatjob,task,fileanddataelementlevelsSMP Advantages• Performance —Ifsomeworkcanbedoneinparallel• Availability —Sinceallprocessorscanperformthesamefunctions, failureofasingleprocessordoesnothaltthesystem• Incrementalgrowth —Usercanenhanceperformancebyaddingadditional processors• Scaling —Vendorscanofferrangeofproductsbasedon numberofprocessorsBlock Diagram of Tightly Coupled MultiprocessorOrganization Classification• Timesharedorcommonbus• Multiportmemory• CentralcontrolunitTime Shared Bus• Simplestform• Structureandinterfacesimilartosingle processorsystem• Followingfeaturesprovided —Addressingdistinguishmodulesonbus —Arbitrationanymodulecanbetemporarymaster —Timesharingifonemodulehasthebus,others mustwaitandmayhavetosuspend• Nowhavemultipleprocessorsaswellas multipleI/Omodules