There are increasing demands for high data rates in modern wireless communication systems. Therefore, researchers are trying their best to develop new technologies and protocols for maximizing both the throughput and spectral efficiency. These efforts are highly important to meet the requirements of the fifth generation wireless systems that are expected to be deployed beyond 2020. Multiple Input Multiple Output (MIMO) systems take advantage of transmitter multiple antennas to either send different data streams which provide multiplexing gain as the same data stream to achieve diversity gain . However, multiplexing MIMO such as the Vertical Bell Laboratories Layered Space-Time (V-BLAST)   scheme suffers from a substantial decoding complexity . Space Time Block Codes are introduced by Alamouti in  to achieve transmit diversity without the knowledge of the channel stat information at the transmitter.
Space Shift Keying (SSK)  and Spatial Modulation(SM)  are novel developments that utilize the multiple antennas at the transmitter to provide multiplexing gain with lower complexity than the VBLAST . The main advantages offered by the SSK and SM schemes are that no Inter-Antenna Synchronization (IAS) is required and the Inter-Channel Interference (ICI) does not form a problem at the receiver . This is because only one single transmit antenna is activated in any symbol duration. However, both SSK and SM do not offer a transmit diversity.
Coherent Space-Time Shift Keying (CSTSK) in  introduces a flexible trade-off between the achievable diversity and multiplexing gain. Time-Orthogonal Signal Design assisted Spatial Modulation (TOSD-SM)  uses time-orthogonal shaping filters that attains a transmit diversity order of two. Space-Time Block Coded Spatial Modulation (STBC-SM)   scheme uses an Alamouti STBC code for achieving a transmit diversity order of two.
Space Time Trellis Codes (STTCs) are introduced by Tarokh et al.  by joining the concept of multi-antenna system with channel coding. The STTCs introduce both diversity and coding gains compared to lower complexity space-time block codes which achieve only diversity gain. Instead of using rank and determinant criterion to determine the coding gain, Chen in  used the trace criterion which governs the coding for systems with large transmit and/or receive antennas. In , the authors introduced STTCs with better distance spectrum. Super orthogonal space trellis time codes (SO-STTC) has been introduced by Jafarkhani in . The SO-STTCs outperform most of the previous STTCs and with lower complexity .
Spatial Modulation for trellis coding (SM-TC) has been introduced in . In , the set partitioning of SO-STTCs is applied to space-time block coded Spatial Modulation to construct super orthogonal trellis coded spatial modulation (SOTC-SM). It has been shown in  that SOTC-SM achieves significantly better bit error rate (BER) and frame error rate (FER) performance than SM-TC. Quadrature spatial modulation has been introduced in  with higher spectral efficiency than conventional spatial modulation. Trellis codes based on QSM is introduced in  but it has no transmit diversity.
In this paper, instead of using the cyclic structure of STBC-CSM proposed in  to increase the data rate, it is used in this paper to expand the codebook of the trellis space time coded spatial modulation. This allows for superior performance with less number of transmit antenna compared to the code introduced in .
The rest of the paper is organized as follows. In Section 2, the STBC-CSM of  is explained. In Section 3, the modified trellis code structure based on STBC-CSM is introduced. In Section 4, the new code structure and different examples are explained. Finally, the results are presented in Section 5, and the paper is concluded in Section 6.
2. The Code Design
In this section, the cyclic space time coded spatial modulation (STBC-CSM) which is the basic building block of our trellis code will be explained.
Alamouti in  has introduced a simple scheme to achieve transmitter space-time diversity without the channel state information being known at the transmitter. The scheme is developed for two transmit antennas where the transmission matrix is given by,
where and are the transmitted symbols drawn from PSK/QAM constellation. Space time block coded spatial modulation (STBC-SM) based on Alamouti matrix is introduced in . In each time instance, two antennas are active and these antennas transmit the Alamouti matrix in two consecutive time slots. The indices of the active antennas are used for spatial multiplexing.
In, , the data rate of the STBC-SM is increased using cyclic structure of the transmitted matrix. The scheme is denoted as STBC-CSM. The STBC-CSM’s transmission matrix for system with transmit antennas has the following structure,
where the transmitting antenna indices for the Alamouti matrix are defined as i and j:
2.2. SO-STBC and Set Partitioning
The super orthogonal trellis codes introduced in  are based on Alamouticodes for two transmit antennas . The transmission matrices are defined as,
where θ is chosen such as there is no expansion on the constellation size. If we consider the code with θ = 0 is the original code then the different values of θ are used to expand the code matrices. Instead of using the rotation angle, θ, in , the expansion of the codebook is done in the spatial domain using a number of transmit antennas, Nt > 2. The scheme is called super orthogonal trellis coded spatial modulation (SOTC-SM) where it is proven by computer simulation that the bit error rate of the SOTC-SM is significantly better than the SO-STBC for the same number of trellis states and transitions in expense of using higher number of transmit antennas.
The set partitioning for the trellis codes in the SOTC-SM is based on the coding gain difference (CGD).
If and are two different transmission-code matrices then the coding gaindistance (CGD) is defined as ,
where is the difference between and and denotes the Hermitian complex conjugate transpose and “det” is the determinant. If the code is not full rank (not full diversity) the determinant can be replaced by the harmonic mean of eigenvalues of .
Example of set partitioning for the code with symbols drawn from the BPSK constellation can be found in Figure 1. The minimum CGD for S, Sa, and Sab are 4, 4, and 16; respectively. The set partitioning for STBC matrices with entry of QPSK and 8-PSK are listed in Table 1 and Table 2; respectively.
2.3. Code Structure
The code construction using the STBC-CSM is provided in this section. Code design for 2 and 3 bits/s/Hz is provided but codes with higher rates can be easily constructed using the same approach. The number of transmit antennas can also take any order but in the provided examples and for the sake of comparison with , 4 to 6 transmit antennas are used. An example of a trellis code is given in Figure 2 where each node in the figure represents a state, the element, represents the transmission vector/matrix when we move from the state i to the state j. As in , the new code structure is represented by S × S state transition matrices where S is the number of Trellis states.
The entries of each transition matrix represent the parallel codewords that are transmitted from the ith state to the jth state, where i is the row index and j is the column index.
Example of 8 state code for Nt = 4 is given in matrix 5. In Equation (6) and Equation (7) represents 8-state and 16-state code for Nt = 6; respectively. The
Figure 1. Set partitioning for BPSK Alamouti ST code.
Table 1. Set partitioning for QPSK; the numbers represent the indices of the symbols in the STBC code.
Table 2. Set partitioning for 8-PSK; the numbers represent the indices of the symbols in the STBC code.
Figure 2. Trellis diagram for 4-state code.
3. Numerical Results and Discussion
In this section, we present some simulation results for the SOTC-CSM system with different number of transmit antennas and make comparison with SOTC-SM. The Frame Error Rate (FER) performance of both schemes is evaluated through Monte Carlo Simulations for different spectral efficiencies, different number of transmit antennas, and/or different number of trellis states. The FER is depicted against the signal to noise ratio (SNR) of each receive antenna. The frame length is assumed to be 40 symbol. The comparison is done based on a fixed spectral efficiency. The FER of the SOTC-CSM with Nt = 4 and Nt = 6 is presented for 2 bps in Figure 3. As seen from the figure, the SOTC-CSM provides SNR gain of 2.04 dB over the SOTC-CSM in case of Nt = 4 at FER = 10−4 and a gain of 1.61 dB in case of Nt = 6 for the same FER. In allthe former cases, the number of Trellis states is eight. For 16-state Trellis in (7) with Nt = 6, the SOTC-CSM provide 1.29 dB gain at FER = 10−4 over the 8-state SOTC-CSM (Nt = 6) and a gain of 2.9 dB over 8-state SOTC-SM (Nt = 6).
The same is repeated for spectral efficiencies of 3 bps in Figure 4 with eight
Figure 3. FER performance for 8-state and 16-state SOTC-CSM schemes at 2 bits/s/Hz and Nt of 4 and 6.
Figure 4. FER performance for 8-state SOTC-CSM schemes at 3 bits/s/Hz and Nt of 4 and 6.
Trellis states. As seen from the figure, the SOTC-CSM provides SNR gain of 1.02 dB over the SOTC-CSM in case of Nt = 4 at FER = 2 × 10−4 and a gain of 0.9 dB in case of Nt = 6 for the same FER.
In this paper, we have introduced a modified version of SOTC-SM. The new code is denoted as SOTC-CSM is based on extended codebook provided by cyclic space time spatial codes. It has been shown through computer simulations that the proposed SOTC-CSM schemes achieve significantly better error performance than SOTC-CSM with the same decoding complexity. The research results allow for designating trellis codes based on better distributed distance spectrum STBC code.
 Mietzner, J., Schober, R., Lampe, L., Gerstacker, W.H. and Hoeher, P.A. (2009) Multiple-Antenna Techniques for Wireless Communications: A Comprehensive Literature Survey. IEEE Communications Surveys & Tutorials, 11, 87-105.
 Foschini, G.J. (1996) Layered Space-Time Architecture for Wireless Communication in a Fading Environment When Using Multiple Antennas. Bell Labs Technical Journal, 1, 41-59.
 Sugiura, S., Chen, S. and Hanzo, L. (2010) Coherent and Differential Space-Time Shift Keying: A Dispersion Matrix Approach. IEEE Transactions on Communications, 8, 3219-3230.
 Jeganathan, J., Ghrayeb, A., Szczecinski, L. and Ceron, A. (2009) Space Shift Keying Moulation for MIMO Channels. IEEE Transactions on Wireless Communications, 8, 3692-3703.
 Rajashekar, S.R., Hari, K.V.S. and Hanzo, L. (2013) Structured Dispersion Matrices from Division Algebra Codes for Space-Time Shift Keying. IEEE Signal Processing Letters, 20, 371-374.
 Sugiura, S., Chen, S. and Hanzo, L. (2011) Generalized Space-Time Shift Keying Designed for Flexible Diversity-, Multiplexing- and Complexity-Tradeoffs. IEEE Transactions on Communications, 10, 1144-1153.
 Di Renzo, M. and Haas, H. (2011) Space Shift Keying (SSK) Modulation: On the Transmit-Diversity/Multiplexing Trade-Off. IEEE International Conference on Communications (ICC), Kyoto, 5-9 June 2011, 1-6.
 Basar, E., Aygolu, U., Panayirci, E. and Poor, H.V. (2011) Space-Time Block Coded Spatial Modulation. IEEE Transactions on Communications, 59, 823-832.
 El Astal, M.-T., Al Habbash, A.H. and Abu-Hudrouss, A. (2018) Low-Complexity Detection for Space-Time Block Coded spatial Modulation Systems. 2018 International Conference on Promising Electronic Technologies (ICPET), Deir El-Balah, 3-4 October 2018, 49-51.
 Tarokh, V., Seshadri, N. and Calderbank, A. (1998) Space-Time Codes for High Data Rate Wireless Communication: Performance Criterion and Code Construction. IEEE Transactions on Information Theory, 44, 744-765.
 Chen, Z., Yuan, J. and Vucetic, B. (2001) Improved Space-Time Trellis Coded Modulation Scheme on Slow Rayleigh Fading Channels. Electronics Letters, 37, 440-441.
 Guixia, K., Ping, Z., Haas, H. and Schulz, E. (2002) Good Space-Time Trellis Codes in Terms of Distance Spectrum. Proceedings IEEE 56th Vehicular Technology Conference, Vancouver, 24-28 September 2002, 252-255.
 Basar, E., Aygolu, U., Panayirci, E. and Poor, H.V. (2011) New Trellis Code Design for Spatial Modulation. IEEE Transactions on Wireless Communications, 10, 2670-2680.