title: Thermodynamics and kinetics of H adsorption and intercalation for graphene on 6H-SiC(0001) from first-principles calculations

abstract: Previous experimental observations for H intercalation under graphene on SiC surfaces motivate clarification of configuration stabilities and kinetic processes related to intercalation. From first-principles density-functional-theory (DFT) calculations, we analyze H adsorption and intercalation for graphene on a 6H-SiC(0001) surface, where the system includes two single-atom-thick graphene layers: the top-layer graphene (TLG) and the underling buffer-layer graphene (BLG) above the terminal Si layer. Our chemical potential analysis shows that, in the low-H coverage regime (described by a single H atom within a sufficiently large supercell), intercalation into the gallery between TLG and BLG, or into the gallery underneath BLG, is more favorable thermodynamically than adsorption on top of TLG. However, intercalation into the gallery between TLG and BLG is most favorable. We obtain energy barriers of about 1.3 eV and 2.3 eV for a H atom diffusing on and under TLG, respectively. From an additional analysis of the energy landscape in the vicinity of a step on the TLG, we assess how readily one guest H atom on the TLG terrace can directly penetrate the TLG into the gallery between TLG and BLG versus crossing a TLG step to access the gallery. We also perform DFT calculations for higher H coverages revealing a shift in favorability to intercalation of H underneath BLG, as well as characterizing the variation with H coverage in interlayer spacings.


title: An initial review of hypersonic vehicle accidents

abstract: Hypersonic flight, generally defined as the region in which the speed of a vehicle exceeds Mach 5 and in which thermal loads become dominant, has seen more attention over the past several decades due to the potential military applications of such vehicles. Vehicles capable of flight at these speeds, whilst seemingly a novel prospect, have been in development for more than 70 years. The nature of flight in this environment as well as the new challenges it introduces have led to relatively high failure rates. This paper presents a review of hypersonic vehicle flights that have resulted in failure from conception to modern day with the purpose of identifying trends to aid and guide the development of future vehicles. The collected data is used to formulate a failure taxonomy to accurately identify and classify past hypersonic vehicle failures as well as potential future ones. The trends and features of the categorical data collected are explored using an ex-post facto study.


title: Statistical CSI-Based Transmission Design for Reconfigurable Intelligent Surface-aided Massive MIMO Systems with Hardware Impairments

abstract: We consider a reconfigurable intelligent surface (RIS)-aided massive multi-user multiple-input multiple-output (MIMO) communication system with transceiver hardware impairments (HWIs) and RIS phase noise. Different from the existing contributions, the phase shifts of the RIS are designed based on the long-term angle informations. Firstly, an approximate analytical expression of the uplink achievable rate is derived. Then, we use genetic algorithm (GA) to maximize the sum rate and the minimum date rate. Finally, we show that it is crucial to take HWIs into account when designing the phase shift of RIS.


title: SDR -- Medium Rare with Fast Computations

abstract: We revisit the widely used bss eval metrics for source separation with an eye out for performance. We propose a fast algorithm fixing shortcomings of publicly available implementations. First, we show that the metrics are fully specified by the squared cosine of just two angles between estimate and reference subspaces. Second, large linear systems are involved. However, they are structured, and we apply a fast iterative method based on conjugate gradient descent. The complexity of this step is thus reduced by a factor quadratic in the distortion filter size used in bss eval, usually 512. In experiments, we assess speed and numerical accuracy. Not only is the loss of accuracy due to the approximate solver acceptable for most applications, but the speed-up is up to two orders of magnitude in some, not so extreme, cases. We confirm that our implementation can train neural networks, and find that longer distortion filters may be beneficial.


title: Incentive-aware Electric Vehicle Routing Problem: a Bi-level Model and a Joint Solution Algorithm

abstract: Fixed pickup and delivery times can strongly limit the performance of freight transportation. Against this backdrop, fleet operators can use compensation mechanisms such as monetary incentives to buy delay time from their customers, in order to improve the fleet efficiency and ultimately minimize the costs of operation. To make the most of such an operational model, the fleet activities and the incentives should be jointly optimized accounting for the customers' reactions. Against this backdrop, this paper presents an incentive-aware electric vehicle routing scheme in which the fleet operator actively provides incentives to the customers in exchange of pickup or delivery time flexibility. Specifically, we first devise a bi-level model whereby the fleet operator optimizes the routes and charging schedules of the fleet jointly with an incentive rate to reimburse the delivery delays experienced by the customers. At the same time, the customers choose the admissible delays by minimizing a monetarily-weighted combination of the delays minus the reimbursement offered by the operator. Second, we tackle the complexity resulting from the bi-level and nonlinear problem structure with an equivalent transformation method, reformulating the problem as a single-level optimization problem that can be solved with standard mixed-integer linear programming algorithms. We demonstrate the effectiveness of our framework via extensive numerical experiments using VRP-REP data from Belgium. Our results show that by jointly optimizing routes and incentives subject to the customers' preferences, the operational costs can be reduced by up to 5%, whilst customers can save more than 30% in total delivery fees.


title: Global regularity of non-diffusive temperature fronts for the 2D viscous Boussinesq system

abstract: In this paper we address the temperature patch problem of the 2D viscous Boussinesq system without heat diffusion term. The temperature satisfies the transport equation and the initial data of temperature is given in the form of non-constant patch, usually called the temperature front initial data. Introducing a good unknown and applying the method of striated estimates, we prove that our partially viscous Boussinesq system admits a unique global regular solution and the initial $C^{k,\gamma}$ and $W^{2,\infty}$ regularity of the temperature front boundary with $k\in \mathbb{Z}^+ = \{1,2,\cdots\}$ and $\gamma\in (0,1)$ will be preserved for all the time. In particular, this naturally extends the previous work by Danchin $\&$ Zhang (2017) and Gancedo $\&$ Garc\'ia-Ju\'arez (2017). In the proof of the persistence result of higher boundary regularity, we introduce the striated type Besov space $\mathcal{B}^{s,\ell}_{p,r,W}(\mathbb{R}^d)$ and establish a series of refined striated estimates in such a function space, which may have its own interest.


title: Harnessing the Conditioning Sensorium for Improved Image Translation

abstract: Multi-modal domain translation typically refers to synthesizing a novel image that inherits certain localized attributes from a 'content' image (e.g. layout, semantics, or geometry), and inherits everything else (e.g. texture, lighting, sometimes even semantics) from a 'style' image. The dominant approach to this task is attempting to learn disentangled 'content' and 'style' representations from scratch. However, this is not only challenging, but ill-posed, as what users wish to preserve during translation varies depending on their goals. Motivated by this inherent ambiguity, we define 'content' based on conditioning information extracted by off-the-shelf pre-trained models. We then train our style extractor and image decoder with an easy to optimize set of reconstruction objectives. The wide variety of high-quality pre-trained models available and simple training procedure makes our approach straightforward to apply across numerous domains and definitions of 'content'. Additionally it offers intuitive control over which aspects of 'content' are preserved across domains. We evaluate our method on traditional, well-aligned, datasets such as CelebA-HQ, and propose two novel datasets for evaluation on more complex scenes: ClassicTV and FFHQ-Wild. Our approach, Sensorium, enables higher quality domain translation for more complex scenes.


title: Large deviation principles for SDEs under locally weak monotonicity conditions

abstract: This paper establishes a Freidlin-Wentzell large deviation principle for stochastic differential equations(SDEs) under locally weak monotonicity conditions and Lyapunov conditions. We illustrate the main result of the paper by showing that it can be applied to SDEs with non-Lipschitzian coefficients, which can not be covered in the existing literature. These include the interesting biological models like stochastic Duffing-van der Pol oscillator model, stochastic SIR model, etc.


title: Generating MCMC proposals by randomly rotating the regular simplex

abstract: We present the simplicial sampler, a class of parallel MCMC methods that generate and choose from multiple proposals at each iteration. The algorithm's multiproposal randomly rotates a simplex connected to the current Markov chain state in a way that inherently preserves symmetry between proposals. As a result, the simplicial sampler leads to a simplified acceptance step: it simply chooses from among the simplex nodes with probability proportional to their target density values. We also investigate a multivariate Gaussian-based symmetric multiproposal mechanism and prove that it also enjoys the same simplified acceptance step. This insight leads to significant theoretical and practical speedups. While both algorithms enjoy natural parallelizability, we show that conventional implementations are sufficient to confer efficiency gains across an array of dimensions and a number of target distributions.


title: Improving Graph-based Sentence Ordering with Iteratively Predicted Pairwise Orderings

abstract: Dominant sentence ordering models can be classified into pairwise ordering models and set-to-sequence models. However, there is little attempt to combine these two types of models, which inituitively possess complementary advantages. In this paper, we propose a novel sentence ordering framework which introduces two classifiers to make better use of pairwise orderings for graph-based sentence ordering. Specially, given an initial sentence-entity graph, we first introduce a graph-based classifier to predict pairwise orderings between linked sentences. Then, in an iterative manner, based on the graph updated by previously predicted high-confident pairwise orderings, another classifier is used to predict the remaining uncertain pairwise orderings. At last, we adapt a GRN-based sentence ordering model on the basis of final graph. Experiments on five commonly-used datasets demonstrate the effectiveness and generality of our model. Particularly, when equipped with BERT and FHDecoder, our model achieves state-of-the-art performance.


title: Influences of accreting primordial black holes on the global 21 cm signal in the dark ages

abstract: Baryonic matter can be accreted on to primordial back holes (PBHs) formed in the early Universe. The radiation from accreting PBHs is capable of altering the evolution of the intergalactic medium (IGM), leaving marks on the global 21 cm signal in the dark ages. For accreting PBHs with mass $M_{\rm PBH}=10^{3}(10^{4})~M_{\odot}$ and mass fraction $f_{\rm PBH}=10^{-1}(10^{-3})$, the brightness temperature deviation $\Delta \delta T_{b}$ reaches $\sim 18~(26)~\rm mK$ at redshift $z\sim 90$ ($\nu \sim 16~\rm MHz$), and the gradient of the brightness temperature $d\delta T_{b}/d\nu$ reaches $ \sim 0.8~(0.5)~\rm mK~MHz^{-1}$ at frequency $\nu\sim 28~\rm MHz$ ($z\sim 50$). For larger PBHs with higher mass fraction, the brightness temperature deviation is larger in the redshift range $z\sim 30-300$ ($\nu\sim 5-46~\rm MHz$), and the gradient is lower at the frequency range $\nu \sim 20-60~\rm MHz$ ($z\sim 23-70$). It is impossible to detect these low frequency radio signals from the Earth due to the influence of the Earth's ionosphere. However, after taking care of the essential factors properly, e.g. the foreground and interference, future radio telescope in lunar orbit or on the farside surface of the Moon has a chance of detecting the global 21 cm signals impacted by accreting PBHs and distinguishing them from the standard model.


title: Reducing the Covariate Shift by Mirror Samples in Cross Domain Alignment

abstract: Eliminating the covariate shift cross domains is one of the common methods to deal with the issue of domain shift in visual unsupervised domain adaptation. However, current alignment methods, especially the prototype based or sample-level based methods neglect the structural properties of the underlying distribution and even break the condition of covariate shift. To relieve the limitations and conflicts, we introduce a novel concept named (virtual) mirror, which represents the equivalent sample in another domain. The equivalent sample pairs, named mirror pairs reflect the natural correspondence of the empirical distributions. Then a mirror loss, which aligns the mirror pairs cross domains, is constructed to enhance the alignment of the domains. The proposed method does not distort the internal structure of the underlying distribution. We also provide theoretical proof that the mirror samples and mirror loss have better asymptotic properties in reducing the domain shift. By applying the virtual mirror and mirror loss to the generic unsupervised domain adaptation model, we achieved consistent superior performance on several mainstream benchmarks. Code is available at https://github.com/CTI-VISION/Mirror-Sample


title: Constrained Detecting Arrays: Mathematical Structures for Fault Identification in Combinatorial Interaction Testing

abstract: Context: Detecting arrays are mathematical structures aimed at fault identification in combinatorial interaction testing. However, they cannot be directly applied to systems that have constraints among test parameters. Such constraints are prevalent in real-world systems. Objectives: This paper proposes Constrained Detecting Arrays (CDAs), an extension of detecting arrays, which can be used for systems with constraints. Methods: The paper examines the properties and capabilities of CDAs with rigorous arguments. The paper also proposes two algorithms for constructing CDAs: One is aimed at generating minimum CDAs and the other is a heuristic algorithm aimed at fast generation of CDAs. The algorithms are evaluated through experiments using a benchmark dataset. Results: Experimental results show that the first algorithm can generate minimum CDAs if a sufficiently long generation time is allowed, and the second algorithm can generate minimum or near-minimum CDAs in a reasonable time. Conclusion: CDAs enhance detecting arrays to be applied to systems with constraints. The two proposed algorithms have different advantages with respect to the array size and generation time


title: Online network change point detection with missing values and temporal dependence

abstract: In this paper we study online change point detection in dynamic networks with time heterogeneous missing pattern within networks and dependence across the time course. The missingness probabilities, the entrywise sparsity of networks, the rank of networks and the jump size in terms of the Frobenius norm, are all allowed to vary as functions of the pre-change sample size. On top of a thorough handling of all the model parameters, we notably allow the edges and missingness to be dependent. To the best of our knowledge, such general framework has not been rigorously nor systematically studied before in the literature. We propose a polynomial time change point detection algorithm, with a version of soft-impute algorithm (e.g. Mazumder et al., 2010; Klopp, 2015) as the imputation sub-routine. Piecing up these standard sub-routines algorithms, we are able to solve a brand new problem with sharp detection delay subject to an overall Type-I error control. Extensive numerical experiments are conducted demonstrating the outstanding performances of our proposed method in practice.


title: Maximum Entropy Differential Dynamic Programming

abstract: In this paper, we present a novel maximum entropy formulation of the Differential Dynamic Programming algorithm and derive two variants using unimodal and multimodal value functions parameterizations. By combining the maximum entropy Bellman equations with a particular approximation of the cost function, we are able to obtain a new formulation of Differential Dynamic Programming which is able to escape from local minima via exploration with a multimodal policy. To demonstrate the efficacy of the proposed algorithm, we provide experimental results using four systems on tasks that are represented by cost functions with multiple local minima and compare them against vanilla Differential Dynamic Programming. Furthermore, we discuss connections with previous work on the linearly solvable stochastic control framework and its extensions in relation to compositionality.


title: "I need a better description'': An Investigation Into User Expectations For Differential Privacy

abstract: Despite recent widespread deployment of differential privacy, relatively little is known about what users think of differential privacy. In this work, we seek to explore users' privacy expectations related to differential privacy. Specifically, we investigate (1) whether users care about the protections afforded by differential privacy, and (2) whether they are therefore more willing to share their data with differentially private systems. Further, we attempt to understand (3) users' privacy expectations of the differentially private systems they may encounter in practice and (4) their willingness to share data in such systems. To answer these questions, we use a series of rigorously conducted surveys (n=2424). We find that users care about the kinds of information leaks against which differential privacy protects and are more willing to share their private information when the risks of these leaks are less likely to happen. Additionally, we find that the ways in which differential privacy is described in-the-wild haphazardly set users' privacy expectations, which can be misleading depending on the deployment. We synthesize our results into a framework for understanding a user's willingness to share information with differentially private systems, which takes into account the interaction between the user's prior privacy concerns and how differential privacy is described.


title: Generalized Borsuk Graphs

abstract: Given a finite group $G$ acting freely on a compact metric space $M$, and $\epsilon>0$, we define the $G$-Borsuk graph on $M$ by drawing edges $x\sim y$ whenever there is a non-identity $g\in G$ such that $d(x,gy)\leq\epsilon$. We show that when $\epsilon$ is small, its chromatic number is determined by the topology of $M$ via its $G$-covering number, which is the minimum $k$ such that there is a closed cover $M=F_1\cup\dots\cup F_k$ with $F_i\cap g(F_i)=\emptyset$ for all $g\in G\setminus\{1\}$. We are interested in bounding this number. We give lower bounds using $G$-actions on Hom-complexes, and upper bounds using a recursive formula on the dimension of $M$. We conjecture that the true chromatic number coincides with the lower bound, and give computational evidence. We also study random $G$-Borsuk graphs, which are random induced subgraphs. For these, we compute thresholds for $\epsilon$ that guarantee that the chromatic number is still that of the whole $G$-Borsuk graph. Our results are tight (up to a constant) when the $G$-index and dimension of $M$ coincide.


title: Energy conversion theorems for some linear steady-states

abstract: One of the main issues that real energy converters present, when they produce effective work, is the inevitable entropy production. Within the context of Non-equilibrium Thermodynamics, entropy production tends to energetically degrade man-made or living systems. On the other hand, it is also not useful to think about designing an energy converter that works in the so-called minimum entropy production regime since the effective power output and efficiency are zero. In this manuscript, we establish some \textit{Energy Conversion Theorems} similar to Prigogine's one with constrained forces, their purpose is to reveal trade-offs between design and the so-called operation modes for $\left(2\times2\right)$--linear isothermal energy converters. The objective functions that give rise to those thermodynamic constraints show stability. A two--meshes electric circuit was built as an example to demonstrate the Theorems' validity. Likewise, we reveal a type of energetic hierarchy for power output, efficiency and dissipation function when the circuit is tuned to any of the operating regimes studied here: maximum power output ($MPO$), maximum efficient power ($MP\eta$), maximum omega function ($M\Omega$), maximum ecological function ($MEF$), maximum efficiency ($M\eta$) and minimum dissipation function ($mdf$).


title: Seismic Tomography with Random Batch Gradient Reconstruction

abstract: Seismic tomography solves high-dimensional optimization problems to image subsurface structures of Earth. In this paper, we propose to use random batch methods to construct the gradient used for iterations in seismic tomography. Specifically, we use the frozen Gaussian approximation to compute seismic wave propagation, and then construct stochastic gradients by random batch methods. The method inherits the spirit of stochastic gradient descent methods for solving high-dimensional optimization problems. The proposed idea is general in the sense that it does not rely on the usage of the frozen Gaussian approximation, and one can replace it with any other efficient wave propagation solvers, e.g., Gaussian beam methods and spectral element methods. We prove the convergence of the random batch method in the mean-square sense, and show the numerical performance of the proposed method by two-dimensional and three-dimensional examples of wave-equation-based travel-time inversion and full-waveform inversion, respectively. As a byproduct, we also prove the convergence of the accelerated full-waveform inversion using dynamic mini-batches and spectral element methods.


title: Updating Street Maps using Changes Detected in Satellite Imagery

abstract: Accurately maintaining digital street maps is labor-intensive. To address this challenge, much work has studied automatically processing geospatial data sources such as GPS trajectories and satellite images to reduce the cost of maintaining digital maps. An end-to-end map update system would first process geospatial data sources to extract insights, and second leverage those insights to update and improve the map. However, prior work largely focuses on the first step of this pipeline: these map extraction methods infer road networks from scratch given geospatial data sources (in effect creating entirely new maps), but do not address the second step of leveraging this extracted information to update the existing digital map data. In this paper, we first explain why current map extraction techniques yield low accuracy when extended to update existing maps. We then propose a novel method that leverages the progression of satellite imagery over time to substantially improve accuracy. Our approach first compares satellite images captured at different times to identify portions of the physical road network that have visibly changed, and then updates the existing map accordingly. We show that our change-based approach reduces map update error rates four-fold.


title: Passive Phased Array Acoustic Emission Localisation via Recursive Signal-Averaged Lamb Waves with an Applied Warped Frequency Transformation

abstract: This work presents a concept for the localisation of Lamb waves using a Passive Phased Array (PPA). A Warped Frequency Transformation (WFT) is applied to the acquired signals using numerically determined phase velocity information to compensate for signal dispersion. Whilst powerful, uncertainty between material properties cannot completely remove dispersion and hence the close intra-element spacing of the array is leveraged to allow for the assumption that each acquired signal is a scaled, translated, and noised copy of its adjacent counterparts. Following this, a recursive signal-averaging method using artificial time-locking to denoise the acquired signals by assuming the presence of non-correlated, zero mean noise is applied. Unlike the application of bandpass filters, the signal-averaging method does not remove potentially useful frequency components. The proposed methodology is compared against a bandpass filtered approach through a parametric study. A further discussion is made regarding applications and future developments of this technique.


title: Stiffness minimisation of graded microstructural configurations using asymptotic analysis and machine learning

abstract: The article is aimed to address a mutually boosting use of asymptotic analysis and machine learning, for fast stiffness design of configurations infilled with smoothly-varying graded microstructures. The discussion is conducted in the context of an improved asymptotic-homogenisation topology optimisation (AHTO plus) framework. It is demonstrated that on one hand, machine learning can be employed to represent the key but implicit inter-relationships revealed from asymptotic analysis, and the evaluations of the homogenised quantities, as well as the sensitivities of the design variables, become quite efficient. On the other hand, the use of asymptotic analysis identifies a computational routine for data acquisition, thus the training data here are inexhaustible in theory. Key issues regarding integration of the two methods, such as ensuring the positive definiteness of the homogenised elasticity tensor represented with neural networks, are also discussed. The accuracies and the efficiencies of the present scheme are numerically demonstrated. For two-dimensional optimisation, it takes the present algorithm roughly 300 seconds on a standard desktop computer, and this qualifies the present scheme as one of the most efficient algorithms used for the compliance optimisation of configurations infilled with complex microstructures.


title: Learning to Select Historical News Articles for Interaction based Neural News Recommendation

abstract: The key to personalized news recommendation is to match the user's interests with the candidate news precisely and efficiently. Most existing approaches embed user interests into a representation vector then recommend by comparing it with the candidate news vector. In such a workflow, fine-grained matching signals may be lost. Recent studies try to cover that by modeling fine-grained interactions between the candidate news and each browsed news article of the user. Despite the effectiveness improvement, these models suffer from much higher computation costs online. Consequently, it remains a tough issue to take advantage of effective interactions in an efficient way. To address this problem, we proposed an end-to-end Selective Fine-grained Interaction framework (SFI) with a learning-to-select mechanism. Instead of feeding all historical news into interaction, SFI can quickly select informative historical news w.r.t. the candidate and exclude others from following computations. We empower the selection to be both sparse and automatic, which guarantees efficiency and effectiveness respectively. Extensive experiments on the publicly available dataset MIND validates the superiority of SFI over the state-of-the-art methods: with only five historical news selected, it can significantly improve the AUC by 2.17% over the state-of-the-art interaction-based models; at the same time, it is four times faster.


title: Data-Time Tradeoffs for Optimal k-Thresholding Algorithms in Compressed Sensing

abstract: Optimal $k$-thresholding algorithms are a class of $k$-sparse signal recovery algorithms that overcome the shortcomings of traditional hard thresholding algorithms caused by the oscillation of the residual function. In this paper, a novel convergence analysis for optimal $k$-thresholding algorithms is established, which reveals the data-time tradeoffs of these algorithms. Both the analysis and numerical results demonstrate that when the number of measurements is small, the algorithms cannot converge; when the number of measurements is suitably large, the number of iterations required for successful recovery has a negative correlation with the number of measurements, and the algorithms can achieve linear convergence. Furthermore, the main theorems indicate that the number of measurements required for successful recovery is of the order of $k \log({n}/{k})$, where $n$ is the dimension of the target signal.


title: Fake News Detection in Spanish Using Deep Learning Techniques

abstract: This paper addresses the problem of fake news detection in Spanish using Machine Learning techniques. It is fundamentally the same problem tackled for the English language; however, there is not a significant amount of publicly available and adequately labeled fake news in Spanish to effectively train a Machine Learning model, similarly to those proposed for the English language. Therefore, this work explores different training strategies and architectures to establish a baseline for further research in this area. Four datasets were used, two in English and two in Spanish, and four experimental schemes were tested, including a baseline with classical Machine Learning models, trained and validated using a small dataset in Spanish. The remaining schemes include state-of-the-art Deep Learning models trained (or fine-tuned) and validated in English, trained and validated in Spanish, and fitted in English and validated with automatic translated Spanish sentences. The Deep Learning architectures were built on top of different pre-trained Word Embedding representations, including GloVe, ELMo, BERT, and BETO (a BERT version trained on a large corpus in Spanish). According to the results, the best strategy was a combination of a pre-trained BETO model and a Recurrent Neural Network based on LSTM layers, yielding an accuracy of up to 80%; nonetheless, a baseline model using a Random Forest estimator obtained similar outcomes. Additionally, the translation strategy did not yield acceptable results because of the propagation error; there was also observed a significant difference in models performance when trained in English or Spanish, mainly attributable to the number of samples available for each language.


title: Simultaneously exploring multi-scale and asymmetric EEG features for emotion recognition

abstract: In recent years, emotion recognition based on electroencephalography (EEG) has received growing interests in the brain-computer interaction (BCI) field. The neuroscience researches indicate that the left and right brain hemispheres demonstrate activity differences under different emotional activities, which could be an important principle for designing deep learning (DL) model for emotion recognition. Besides, owing to the nonstationarity of EEG signals, using convolution kernels of a single size may not sufficiently extract the abundant features for EEG classification tasks. Based on these two angles, we proposed a model termed Multi-Scales Bi-hemispheric Asymmetric Model (MSBAM) based on convolutional neural network (CNN) structure. Evaluated on the public DEAP and DREAMER datasets, MSBAM achieved over 99% accuracy for the two-class classification of low-level and high-level states in each of four emotional dimensions, i.e., arousal, valence, dominance and liking, respectively. This study further demonstrated the promising potential to design the DL model from the multi-scale characteristics of the EEG data and the neural mechanisms of the emotion cognition.


title: Regularization dependence of pion generalised parton distributions

abstract: Pion generalised parton distributions are calculated within the framework of the Nambu--Jona-Lasinio model using different regularization schemes, including the proper time regularization scheme, the three dimensional momentum cutoff scheme, the four dimensional momentum cutoff scheme, and the Pauli-Villars regularization scheme. Furthermore, we check the theoretical constraints of pion generalised parton distributions required by the symmetries of quantum chromodynamics in different regularization schemes. The diagrams of pion parton distribution functions are plotted, in addition, we evaluate the Mellin moments of generalised parton distributions, which related to the electromagnetic and gravitational form factors of pion. Pion generalised parton distributions are continuous but not differential at $x=\pm \,\xi$, when considering the effect of D-term, generalised parton distributions become not continuous at $x=\pm \,\xi$ in all the four regularization schemes. Generalised parton distributions in impact parameter space are considered, the width distribution of $u$ quark in the pion and the mean-squared $\langle \mathbf{b}_{\bot}^2\rangle_{\pi}^u$ are calculated. The light-front transverse-spin distributions are studied, when quark polarized in the light-front-transverse $+\,x$ direction, the transverse-spin density is no longer symmetric around $(b_x=0,b_y=0)$, the peaks shift to $(b_x=0,b_y>0)$, we compare the average transverse shift $\langle b_{\bot}^y\rangle_1^u$ and $\langle b_{\bot}^y\rangle_2^u$ in different regularization schemes. The light-cone energy radius $r_{E,LC}$ and the light-cone charge radius $r_{c,LC}$ are also evaluated, we find that in the proper time regularization scheme the values of these quantities are the largest, in the three dimensional momentum cutoff scheme they are the smallest.


title: Data-driven distributionally robust risk parity portfolio optimization

abstract: We propose a distributionally robust formulation of the traditional risk parity portfolio optimization problem. Distributional robustness is introduced by targeting the discrete probabilities attached to each observation used during parameter estimation. Instead of assuming that all observations are equally likely, we consider an ambiguity set that provides us with the flexibility to find the most adversarial probability distribution based on the investor's desired degree of robustness. This allows us to derive robust estimates to parametrize the distribution of asset returns without having to impose any particular structure on the data. The resulting distributionally robust optimization problem is a constrained convex-concave minimax problem. Our approach is financially meaningful and attempts to attain full risk diversification with respect to the worst-case instance of the portfolio risk measure. We propose a novel algorithmic approach to solve this minimax problem, which blends projected gradient ascent with sequential convex programming. By design, this algorithm is highly flexible and allows the user to choose among alternative statistical distance measures to define the ambiguity set. Moreover, the algorithm is highly tractable and scalable. Our numerical experiments suggest that a distributionally robust risk parity portfolio can yield a higher risk-adjusted rate of return when compared against the nominal portfolio.


title: Breaking the Dilemma of Medical Image-to-image Translation

abstract: Supervised Pix2Pix and unsupervised Cycle-consistency are two modes that dominate the field of medical image-to-image translation. However, neither modes are ideal. The Pix2Pix mode has excellent performance. But it requires paired and well pixel-wise aligned images, which may not always be achievable due to respiratory motion or anatomy change between times that paired images are acquired. The Cycle-consistency mode is less stringent with training data and works well on unpaired or misaligned images. But its performance may not be optimal. In order to break the dilemma of the existing modes, we propose a new unsupervised mode called RegGAN for medical image-to-image translation. It is based on the theory of "loss-correction". In RegGAN, the misaligned target images are considered as noisy labels and the generator is trained with an additional registration network to fit the misaligned noise distribution adaptively. The goal is to search for the common optimal solution to both image-to-image translation and registration tasks. We incorporated RegGAN into a few state-of-the-art image-to-image translation methods and demonstrated that RegGAN could be easily combined with these methods to improve their performances. Such as a simple CycleGAN in our mode surpasses latest NICEGAN even though using less network parameters. Based on our results, RegGAN outperformed both Pix2Pix on aligned data and Cycle-consistency on misaligned or unpaired data. RegGAN is insensitive to noises which makes it a better choice for a wide range of scenarios, especially for medical image-to-image translation tasks in which well pixel-wise aligned data are not available


title: Effects of Phase Difference between Instability Modes on Boundary Layer Transition

abstract: Phase effect on the modal interaction of flow instabilities is investigated for laminar-to-turbulent transition in a flat-plate boundary layer flow. Primary and secondary instabilities are numerically studied with 2D Tollmien-Schlichting wave and subharmonic 3D oblique waves at various initial phase differences between these two instability modes. Three numerical methods are used for a systematic approach for the entire transition process, i.e., before the onset of transition well into fully turbulent flow. The Floquet analysis predicts the subharmonic resonance where a subharmonic mode locally resonates for a given basic flow composed of the steady laminar flow and the fundamental mode. Because the Floquet analysis is limited to the resonating subharmonic mode, nonlinear parabolized stability equations (PSE) simulation is conducted with various phase shifts of the subharmonic mode with respect to the given fundamental mode. PSE offers insights on the modal interaction affected by the phase difference up to the weakly nonlinear stage of transition. Large-eddy simulation (LES) is conducted for a complete transition to turbulent boundary layer because PSE becomes prohibitively expensive in the late nonlinear stage of transition. The modulation of the subharmonic resonance with the initial phase difference leads to a significant delay in the transition location up to $\Delta Re_{x, tr} \simeq 4\times 10^5$ as predicted by the current LES. Effects of the initial phase difference on the spatial evolution of the modal shape of the subharmonic mode are further investigated. The mechanism of the phase evolution is discussed, based on current numerical results and relevant literature data.


title: Dual-branch Attention-In-Attention Transformer for single-channel speech enhancement

abstract: Curriculum learning begins to thrive in the speech enhancement area, which decouples the original spectrum estimation task into multiple easier sub-tasks to achieve better performance. Motivated by that, we propose a dual-branch attention-in-attention transformer dubbed DB-AIAT to handle both coarse- and fine-grained regions of the spectrum in parallel. From a complementary perspective, a magnitude masking branch is proposed to coarsely estimate the overall magnitude spectrum, and simultaneously a complex refining branch is elaborately designed to compensate for the missing spectral details and implicitly derive phase information. Within each branch, we propose a novel attention-in-attention transformer-based module to replace the conventional RNNs and temporal convolutional networks for temporal sequence modeling. Specifically, the proposed attention-in-attention transformer consists of adaptive temporal-frequency attention transformer blocks and an adaptive hierarchical attention module, aiming to capture long-term temporal-frequency dependencies and further aggregate global hierarchical contextual information. Experimental results on Voice Bank + DEMAND demonstrate that DB-AIAT yields state-of-the-art performance (e.g., 3.31 PESQ, 95.6% STOI and 10.79dB SSNR) over previous advanced systems with a relatively small model size (2.81M).


title: Graph-Fraudster: Adversarial Attacks on Graph Neural Network Based Vertical Federated Learning

abstract: Graph neural network (GNN) has achieved great success on graph representation learning. Challenged by large scale private data collected from user-side, GNN may not be able to reflect the excellent performance, without rich features and complete adjacent relationships. Addressing the problem, vertical federated learning (VFL) is proposed to implement local data protection through training a global model collaboratively. Consequently, for graph-structured data, it is a natural idea to construct a GNN based VFL framework, denoted as GVFL. However, GNN has been proved vulnerable to adversarial attacks. Whether the vulnerability will be brought into the GVFL has not been studied. This is the first study of adversarial attacks on GVFL. A novel adversarial attack method is proposed, named Graph-Fraudster. It generates adversarial perturbations based on the noise-added global node embeddings via the privacy leakage and the gradient of pairwise node. Specifically, first, Graph-Fraudster steals the global node embeddings and sets up a shadow model of the server for the attack generator. Second, noise is added into node embeddings to confuse the shadow model. At last, the gradient of pairwise node is used to generate attacks with the guidance of noise-added node embeddings. Extensive experiments on five benchmark datasets demonstrate that Graph-Fraudster achieves the state-of-the-art attack performance compared with baselines in different GNN based GVFLs. Furthermore, Graph-Fraudster can remain a threat to GVFL even if two possible defense mechanisms are applied. Additionally, some suggestions are put forward for the future work to improve the robustness of GVFL. The code and datasets can be downloaded at https://github.com/hgh0545/Graph-Fraudster.


title: Third quantization for scalar and spinor wave functions of the Universe in an extended minisuperspace

abstract: We consider the third quantization in quantum cosmology of a minisuperspace extended by the Eisenhart-Duval lift. We study the third quantization based on both Klein-Gordon type and Dirac-type equations in the extended minisuperspace. Spontaneous creation of "universes" is investigated upon the quantization of a simple model. We find that the quantization of the Dirac-type wave function reveals that the number density of universes is expressed by the Fermi-Dirac distribution. We also calculate the entanglement entropy of the multi-universe system.


title: Control Co-Design for Buoyancy-Controlled MHK Turbine: A Nested Optimization of Geometry and Spatial-Temporal Path Planning

abstract: Recent research progress has confirmed that using advanced controls can result in massive increases in energy capture for marine hydrokinetic (MHK) energy systems, including ocean current turbines (OCTs) and wave energy converters (WECs); however, to realize maximum benefits, the controls, power-take-off system, and basic structure of the device must all be co-designed from early stages. This paper presents an OCT turbine control co-design framework, accounting for the plant geometry and spatial-temporal path planning to optimize the performance. Developing a control co-design framework means that it is now possible to evaluate the effects of changing plant geometry on a level playing field when accounting for the OCT plant power optimization. The investigated framework evaluates the key design parameters, including the sizes of the generator, rotor, and variable buoyancy tank in the OCT system, and formulates these parameters' effect on the OCT model and harnessed power through defining a power-to-weight ratio, subject to the design and operational constraints. The control co-design is formulated as a nested optimization problem, where the outer loop optimizes the plant geometry and the inner loop accounts for the spatial-temporal path planning to optimize the harnessed power with respect to the linear model of the OCT system and ocean current uncertainties. Compared with a baseline design, results verify the efficacy of the proposed framework in co-designing an optimal OCT system to gain the maximum power-to-weight ratio.


title: How stars formed in warps settle into (and contaminate) thick discs

abstract: In recent years star formation has been discovered in the Milky Way's warp. These stars formed in the warp (warp stars) must eventually settle into the plane of the disc. We use an $N$-body$+$smooth particle hydrodynamics model of a warped galaxy to study how warp stars settle into the disc. By following warp stars in angular momentum space, we show that they first tilt to partially align with the main disc in a time scale of $\sim1$ Gyr. Then, once differential precession halts this process, they phase mix into an axisymmetric distribution on a time scale of $\sim 6$ Gyr. The warp stars end up contaminating the geometric thick disc. Because the warp in our fiducial simulation is growing, the {\it warp stars} settle to a distribution with a negative vertical age gradient as younger stars settle further from the mid-plane. While vertically extended, warp star orbits are still nearly circular and they are therefore subject to radial migration, with a net movement inwards. As a result warp stars can be found throughout the disc. The density distribution of a given population of warp stars evolves from a torus to an increasingly centrally filled-in density distribution. Therefore we argue that, in the Milky Way, warp stars should be found in the Solar Neighbourhood. Moreover, settled warp stars may constitute part of the young flaring population seen in the Milky Way's outskirts.


title: Harmonic Tutte polynomials of matroids

abstract: In the present paper, we introduce the concept of harmonic Tutte polynomials of matroids and discuss some of their properties. In particular, we generalize Greene's theorem, thereby expressing harmonic weight enumerators of codes as evaluations of harmonic Tutte polynomials.


title: Exponential Ergodicity for Time-Periodic McKean-Vlasov SDEs

abstract: As extensions to the corresponding results derived for time homogeneous McKean- Vlasov SDEs, the exponential ergodicity is proved for time-periodic distribution dependent SDEs in three different situations: 1) in the quadratic Wasserstein distance and relative entropy for the dissipative case; 2) in the Wasserstein distance induced by a cost function for the partially dissipative case; and 3) in the weighted Wasserstein distance induced by a cost function and a Lyapunov function for the fully non-dissipative case. The main results are illustrated by time inhomogeneous granular media equations, and are extended to reflecting McKean-Vlasov SDEs in a convex domain.


title: ActiveEA: Active Learning for Neural Entity Alignment

abstract: Entity Alignment (EA) aims to match equivalent entities across different Knowledge Graphs (KGs) and is an essential step of KG fusion. Current mainstream methods -- neural EA models -- rely on training with seed alignment, i.e., a set of pre-aligned entity pairs which are very costly to annotate. In this paper, we devise a novel Active Learning (AL) framework for neural EA, aiming to create highly informative seed alignment to obtain more effective EA models with less annotation cost. Our framework tackles two main challenges encountered when applying AL to EA: (1) How to exploit dependencies between entities within the AL strategy. Most AL strategies assume that the data instances to sample are independent and identically distributed. However, entities in KGs are related. To address this challenge, we propose a structure-aware uncertainty sampling strategy that can measure the uncertainty of each entity as well as its impact on its neighbour entities in the KG. (2) How to recognise entities that appear in one KG but not in the other KG (i.e., bachelors). Identifying bachelors would likely save annotation budget. To address this challenge, we devise a bachelor recognizer paying attention to alleviate the effect of sampling bias. Empirical results show that our proposed AL strategy can significantly improve sampling quality with good generality across different datasets, EA models and amount of bachelors.


title: SAR-Net: A Scenario-Aware Ranking Network for Personalized Fair Recommendation in Hundreds of Travel Scenarios

abstract: The travel marketing platform of Alibaba serves an indispensable role for hundreds of different travel scenarios from Fliggy, Taobao, Alipay apps, etc. To provide personalized recommendation service for users visiting different scenarios, there are two critical issues to be carefully addressed. First, since the traffic characteristics of different scenarios, it is very challenging to train a unified model to serve all. Second, during the promotion period, the exposure of some specific items will be re-weighted due to manual intervention, resulting in biased logs, which will degrade the ranking model trained using these biased data. In this paper, we propose a novel Scenario-Aware Ranking Network (SAR-Net) to address these issues. SAR-Net harvests the abundant data from different scenarios by learning users' cross-scenario interests via two specific attention modules, which leverage the scenario features and item features to modulate the user behavior features, respectively. Then, taking the encoded features of previous module as input, a scenario-specific linear transformation layer is adopted to further extract scenario-specific features, followed by two groups of debias expert networks, i.e., scenario-specific experts and scenario-shared experts. They output intermediate results independently, which are further fused into the final result by a multi-scenario gating module. In addition, to mitigate the data fairness issue caused by manual intervention, we propose the concept of Fairness Coefficient (FC) to measures the importance of individual sample and use it to reweigh the prediction in the debias expert networks. Experiments on an offline dataset covering over 80 million users and 1.55 million travel items and an online A/B test demonstrate the effectiveness of our SAR-Net and its superiority over state-of-the-art methods.


title: Winning the ICCV'2021 VALUE Challenge: Task-aware Ensemble and Transfer Learning with Visual Concepts

abstract: The VALUE (Video-And-Language Understanding Evaluation) benchmark is newly introduced to evaluate and analyze multi-modal representation learning algorithms on three video-and-language tasks: Retrieval, QA, and Captioning. The main objective of the VALUE challenge is to train a task-agnostic model that is simultaneously applicable for various tasks with different characteristics. This technical report describes our winning strategies for the VALUE challenge: 1) single model optimization, 2) transfer learning with visual concepts, and 3) task-aware ensemble. The first and third strategies are designed to address heterogeneous characteristics of each task, and the second one is to leverage rich and fine-grained visual information. We provide a detailed and comprehensive analysis with extensive experimental results. Based on our approach, we ranked first place on the VALUE and QA phases for the competition.


title: Feudal Reinforcement Learning by Reading Manuals

abstract: Reading to act is a prevalent but challenging task which requires the ability to reason from a concise instruction. However, previous works face the semantic mismatch between the low-level actions and the high-level language descriptions and require the human-designed curriculum to work properly. In this paper, we present a Feudal Reinforcement Learning (FRL) model consisting of a manager agent and a worker agent. The manager agent is a multi-hop plan generator dealing with high-level abstract information and generating a series of sub-goals in a backward manner. The worker agent deals with the low-level perceptions and actions to achieve the sub-goals one by one. In comparison, our FRL model effectively alleviate the mismatching between text-level inference and low-level perceptions and actions; and is general to various forms of environments, instructions and manuals; and our multi-hop plan generator can significantly boost for challenging tasks where multi-step reasoning form the texts is critical to resolve the instructed goals. We showcase our approach achieves competitive performance on two challenging tasks, Read to Fight Monsters (RTFM) and Messenger, without human-designed curriculum learning.


title: Theoretical Study of Temperature Dependence of Spin Susceptibility in Anisotropic Itinerant Ferromagnets

abstract: We developed a framework for directly calculating the spin susceptibility of anisotropic itinerant ferromagnets in the full temperature range within the coherent potential approximation in the disordered local moment picture. As a test of our formulation, we demonstrate the computation for the temperature ($T$) dependence of the spin susceptibility for Rashba-type ferromagnets with the Curie temperature $T_\mathrm{C}$. In a certain parameter, we found that the inverse transverse susceptibility $1/\chi_\perp\simeq\mathrm{const.}$ for $T<T_\mathrm{C}$ and $1/\chi_\perp\propto T-T_\mathrm{C}$ for $T>T_\mathrm{C}$, which reflects characteristics of itinerant ferromagnets including a spin-orbit interaction.


title: Variational and numerical analysis of a $\mathbf{Q}$-tensor model for smectic-A liquid crystals

abstract: We analyse an energy minimisation problem recently proposed for modelling smectic-A liquid crystals. The optimality conditions give a coupled nonlinear system of partial differential equations, with a second-order equation for the tensor-valued nematic order parameter $\mathbf{Q}$ and a fourth-order equation for the scalar-valued smectic density variation $u$. Our two main results are a proof of the existence of solutions to the minimisation problem, and the derivation of a priori error estimates for its discretisation of the decoupled case (i.e., $q=0$) using the $\mathcal{C}^0$ interior penalty method. More specifically, optimal rates in the $H^1$ and $L^2$ norms are obtained for $\mathbf{Q}$, while optimal rates in a mesh-dependent norm and $L^2$ norm are obtained for $u$. Numerical experiments confirm the rates of convergence.


abstract: We propose the Fourier-domain transfer entropy spectrum, a novel generalization of transfer entropy, as a model-free metric of causality. For arbitrary systems, this approach systematically quantifies the causality among their different system components rather than merely analyze systems as entireties. The generated spectrum offers a rich-information representation of time-varying latent causal relations, efficiently dealing with non-stationary processes and high-dimensional conditions. We demonstrate its validity in the aspects of parameter dependence, statistic significance test, and sensibility. An open-source multi-platform implementation of this metric is developed and computationally applied on neuroscience data sets and diffusively coupled logistic oscillators.

categories: physics.data-an physics.bio-ph physics.comp-ph stat.CO


title: Characterization of Fuchsian groups as laminar groups & the structure theorem of hyperbolic 2-orbifolds

abstract: Thurston and Calegari-Dunfield showed that the fundamental group of some tautly foliated hyperbolic 3-manifold acts on the circle in a distinctive way that the action preserves some structure of S^1, so-called a circle lamination. Indeed, a large class of Kleinian groups acts on the circle preserving a circle lamination. In this paper, we are concerned with the converse problem that a group acting on the circle with at least two invariant circle laminations is Kleinian. We prove that a subgroup of the orientation preserving circle homeomorphism group is a Fuchsian group whose quotient orbifold is not a geometric pair of pants (or turnover) if and only if it preserves three circle laminations with a certain transversality. This is the complete generalization of the previous result of the first author which is proven under the assumption that the subgroup is discrete and torsion-free. On the way to our main result, we also show a structure theorem (generalized pants decomposition) for complete 2-dimensional hyperbolic orbifolds, including the case of infinite type, which is of independent interest.


title: Parallel Deep Neural Networks Have Zero Duality Gap

abstract: Training deep neural networks is a challenging non-convex optimization problem. Recent work has proven that the strong duality holds (which means zero duality gap) for regularized finite-width two-layer ReLU networks and consequently provided an equivalent convex training problem. However, extending this result to deeper networks remains to be an open problem. In this paper, we prove that the duality gap for deeper linear networks with vector outputs is non-zero. In contrast, we show that the zero duality gap can be obtained by stacking standard deep networks in parallel, which we call a parallel architecture, and modifying the regularization. Therefore, we prove the strong duality and existence of equivalent convex problems that enable globally optimal training of deep networks. As a by-product of our analysis, we demonstrate that the weight decay regularization on the network parameters explicitly encourages low-rank solutions via closed-form expressions. In addition, we show that strong duality holds for three-layer standard ReLU networks given rank-1 data matrices.


title: False Negative Distillation and Contrastive Learning for Personalized Outfit Recommendation

abstract: Personalized outfit recommendation has recently been in the spotlight with the rapid growth of the online fashion industry. However, recommending outfits has two significant challenges that should be addressed. The first challenge is that outfit recommendation often requires a complex and large model that utilizes visual information, incurring huge memory and time costs. One natural way to mitigate this problem is to compress such a cumbersome model with knowledge distillation (KD) techniques that leverage knowledge from a pretrained teacher model. However, it is hard to apply existing KD approaches in recommender systems (RS) to the outfit recommendation because they require the ranking of all possible outfits while the number of outfits grows exponentially to the number of consisting clothing items. Therefore, we propose a new KD framework for outfit recommendation, called False Negative Distillation (FND), which exploits false-negative information from the teacher model while not requiring the ranking of all candidates. The second challenge is that the explosive number of outfit candidates amplifying the data sparsity problem, often leading to poor outfit representation. To tackle this issue, inspired by the recent success of contrastive learning (CL), we introduce a CL framework for outfit representation learning with two proposed data augmentation methods. Quantitative and qualitative experiments on outfit recommendation datasets demonstrate the effectiveness and soundness of our proposed methods.


title: Domain Adaptive Semantic Segmentation without Source Data

abstract: Domain adaptive semantic segmentation is recognized as a promising technique to alleviate the domain shift between the labeled source domain and the unlabeled target domain in many real-world applications, such as automatic pilot. However, large amounts of source domain data often introduce significant costs in storage and training, and sometimes the source data is inaccessible due to privacy policies. To address these problems, we investigate domain adaptive semantic segmentation without source data, which assumes that the model is pre-trained on the source domain, and then adapting to the target domain without accessing source data anymore. Since there is no supervision from the source domain data, many self-training methods tend to fall into the ``winner-takes-all'' dilemma, where the {\it majority} classes totally dominate the segmentation networks and the networks fail to classify the {\it minority} classes. Consequently, we propose an effective framework for this challenging problem with two components: positive learning and negative learning. In positive learning, we select the class-balanced pseudo-labeled pixels with intra-class threshold, while in negative learning, for each pixel, we investigate which category the pixel does not belong to with the proposed heuristic complementary label selection. Notably, our framework can be easily implemented and incorporated with other methods to further enhance the performance. Extensive experiments on two widely-used synthetic-to-real benchmarks demonstrate our claims and the effectiveness of our framework, which outperforms the baseline with a large margin. Code is available at \url{https://github.com/fumyou13/LDBE}.


title: Communication-Efficient Triangle Counting under Local Differential Privacy

abstract: Triangle counting in networks under LDP (Local Differential Privacy) is a fundamental task for analyzing connection patterns or calculating a clustering coefficient while strongly protecting sensitive friendships from a central server. In particular, a recent study proposes an algorithm for this task that uses two rounds of interaction between users and the server to significantly reduce estimation error. However, this algorithm suffers from a prohibitively high communication cost due to a large noisy graph each user needs to download. In this work, we propose triangle counting algorithms under LDP with a small estimation error and communication cost. We first propose two-rounds algorithms consisting of edge sampling and carefully selecting edges each user downloads so that the estimation error is small. Then we propose a double clipping technique, which clips the number of edges and then the number of noisy triangles, to significantly reduce the sensitivity of each user's query. Through comprehensive evaluation, we show that our algorithms dramatically reduce the communication cost of the existing algorithm, e.g., from 6 hours to 8 seconds or less at a 20 Mbps download rate, while keeping a small estimation error.


title: Understanding of Emotion Perception from Art

abstract: Computational modeling of the emotions evoked by art in humans is a challenging problem because of the subjective and nuanced nature of art and affective signals. In this paper, we consider the above-mentioned problem of understanding emotions evoked in viewers by artwork using both text and visual modalities. Specifically, we analyze images and the accompanying text captions from the viewers expressing emotions as a multimodal classification task. Our results show that single-stream multimodal transformer-based models like MMBT and VisualBERT perform better compared to both image-only models and dual-stream multimodal models having separate pathways for text and image modalities. We also observe improvements in performance for extreme positive and negative emotion classes, when a single-stream model like MMBT is compared with a text-only transformer model like BERT.


title: Recent trends in Social Engineering Scams and Case study of Gift Card Scam

abstract: Social engineering scams (SES) has been existed since the adoption of the telecommunications by humankind. An earlier version of the scams include leveraging premium phone service to charge the consumers and service providers but not limited to. There are variety of techniques being considered to scam the people due to the advancements in digital data access capabilities and Internet technology. A lot of research has been done to identify the scammer methodologies and characteristics of the scams. However, the scammers finding new ways to lure the consumers and stealing their financial assets. An example would be a recent circumstance of Covid-19 unemployment, which was used as a weapon to scam the US citizens. These scams will not be stopping here, and will keep appearing with new social engineering strategies in the near future. So, to better prepare these kind of scams in ever-changing world, we describe the recent trends of various social engineering scams targeting the innocent people all over the world, who oversight the consequences of scams,and also give detailed description of recent social engineering scams including Covid scams. The social engineering scan threat model architecture is also proposed to map various scams. In addition, we discuss the case study of real-time gift card scam targeting various enterprise organization customers to steal their money and put the organization reputation in stake. We also provide recommendations to internet users for not falling a victim of social engineering scams. In the end, we provide insights on how to prepare/respond to the social engineering scams by following the security incident detection and response life cycle in enterprises


title: The Convex Geometry of Backpropagation: Neural Network Gradient Flows Converge to Extreme Points of the Dual Convex Program

abstract: We study non-convex subgradient flows for training two-layer ReLU neural networks from a convex geometry and duality perspective. We characterize the implicit bias of unregularized non-convex gradient flow as convex regularization of an equivalent convex model. We then show that the limit points of non-convex subgradient flows can be identified via primal-dual correspondence in this convex optimization problem. Moreover, we derive a sufficient condition on the dual variables which ensures that the stationary points of the non-convex objective are the KKT points of the convex objective, thus proving convergence of non-convex gradient flows to the global optimum. For a class of regular training data distributions such as orthogonal separable data, we show that this sufficient condition holds. Therefore, non-convex gradient flows in fact converge to optimal solutions of a convex optimization problem. We present numerical results verifying the predictions of our theory for non-convex subgradient descent.


title: Graphs with nonnegative Ricci curvature and maximum degree at most 3

abstract: In this paper, we classify graphs with nonnegative Lin-Lu-Yau-Ollivier Ricci curvature, maximum degree at most 3 and diameter at least 6.


title: Dict-BERT: Enhancing Language Model Pre-training with Dictionary

abstract: Pre-trained language models (PLMs) aim to learn universal language representations by conducting self-supervised training tasks on large-scale corpora. Since PLMs capture word semantics in different contexts, the quality of word representations highly depends on word frequency, which usually follows a heavy-tailed distributions in the pre-training corpus. Therefore, the embeddings of rare words on the tail are usually poorly optimized. In this work, we focus on enhancing language model pre-training by leveraging definitions of the rare words in dictionaries (e.g., Wiktionary). To incorporate a rare word definition as a part of input, we fetch its definition from the dictionary and append it to the end of the input text sequence. In addition to training with the masked language modeling objective, we propose two novel self-supervised pre-training tasks on word and sentence-level alignment between input text sequence and rare word definitions to enhance language modeling representation with dictionary. We evaluate the proposed Dict-BERT model on the language understanding benchmark GLUE and eight specialized domain benchmark datasets. Extensive experiments demonstrate that Dict-BERT can significantly improve the understanding of rare words and boost model performance on various NLP downstream tasks.


title: Dimensional reduction in quantum spin-1/2 system on a 1/7-depleted triangular lattice

abstract: We study the magnetism of a quantum spin-1/2 antiferromagnet on a maple-leaf lattice which is obtained by regularly depleting 1/7 of the sites of a triangular lattice. Although the interactions are set to be spatially uniform, the ground state shows a stripe Neel order and the temperature dependence of magnetic susceptibility follows that of the one-dimensional XXZ model with a finite spin gap. We examine the nature of frustration by mapping the low energy degenerate manifold of states to the fully packed loop-string model on a dual cluster-depleted honeycomb lattice, finding that the order-by-disorder due to quantum fluctuation characteristic of highly frustrated magnets is responsible for the emergent stripes. The excited magnons split into two spinons and propagate in the one-dimensional direction along the stripe which is reminiscent of the XXZ or Ising model in one dimension. Unlike most of the previously studied dimensional reduction effects, our case is purely spontaneous as the interactions of the Hamiltonian retains a spatially isotropic two-dimensional structure.


title: Understanding of a brain spatial map based on threshold-free function dendrogramization

abstract: Linear matrix factorizations (LMFs) such as independent component analysis (ICA), principal component analysis (PCA), and their extensions, have been widely used for finding relevant spatial maps in brain imaging data. The last step of an LMF before interpretation is usually to extract the activated brain regions from the map by thresholding. However, it is difficult to determine an appropriate threshold level. Thresholding can remove the underlying properties of spatial maps and their features imposed by the model. In this study, we propose a threshold-free activated region extraction method which involves simplifying a brain spatial map to a dendrogram through Morse filtration. Since a dendrogram is related to the change of clustering structure in Rips filtration, we first show the relationship between the Rips filtration of a graph and the Morse filtration of a function. Then, we dendrogramize a spatial map in order to visualize the activated brain regions and the range of their importance in a spatial map. The proposed method can be applied to any spatial maps that a user wants to threshold and interpret. In experiments, we applied the proposed method to independent component maps (ICMs) obtained from resting-state fMRI data, and the dominant subnetworks obtained by the PCA of a correlation-based functional connectivity of FDG PET Alzheimer's disease neuroimaging initiative (ADNI) data. We found that dendrogramization can help to understand a brain spatial map without thresholding.


title: Mathematical inequalities on some weighted means

abstract: Some mathematical inequalities among various weighted means are studied. Inequalities on weighted logarithmic mean are given. Besides, the gap in Jensen's inequality is studied as a convex function approach. Consequently, some non-trivial inequalities on means are given. Some operator inequalities are also shown.


title: Music Source Separation with Deep Equilibrium Models

abstract: While deep neural network-based music source separation (MSS) is very effective and achieves high performance, its model size is often a problem for practical deployment. Deep implicit architectures such as deep equilibrium models (DEQ) were recently proposed, which can achieve higher performance than their explicit counterparts with limited depth while keeping the number of parameters small. This makes DEQ also attractive for MSS, especially as it was originally applied to sequential modeling tasks in natural language processing and thus should in principle be also suited for MSS. However, an investigation of a good architecture and training scheme for MSS with DEQ is needed as the characteristics of acoustic signals are different from those of natural language data. Hence, in this paper we propose an architecture and training scheme for MSS with DEQ. Starting with the architecture of Open-Unmix (UMX), we replace its sequence model with DEQ. We refer to our proposed method as DEQ-based UMX (DEQ-UMX). Experimental results show that DEQ-UMX performs better than the original UMX while reducing its number of parameters by 30%.


title: Cross-lingual COVID-19 Fake News Detection

abstract: The COVID-19 pandemic poses a great threat to global public health. Meanwhile, there is massive misinformation associated with the pandemic which advocates unfounded or unscientific claims. Even major social media and news outlets have made an extra effort in debunking COVID-19 misinformation, most of the fact-checking information is in English, whereas some unmoderated COVID-19 misinformation is still circulating in other languages, threatening the health of less-informed people in immigrant communities and developing countries. In this paper, we make the first attempt to detect COVID-19 misinformation in a low-resource language (Chinese) only using the fact-checked news in a high-resource language (English). We start by curating a Chinese real&fake news dataset according to existing fact-checking information. Then, we propose a deep learning framework named CrossFake to jointly encode the cross-lingual news body texts and capture the news content as much as possible. Empirical results on our dataset demonstrate the effectiveness of CrossFake under the cross-lingual setting and it also outperforms several monolingual and cross-lingual fake news detectors. The dataset is available at https://github.com/YingtongDou/CrossFake.


title: Two-variable polynomials with dynamical Mahler measure zero

abstract: We discuss several aspects of the dynamical Mahler measure for multivariate polynomials. We prove a weak dynamical version of Boyd--Lawton formula and we characterize the polynomials with integer coefficients having dynamical Mahler measure zero both for the case of one variable (Kronecker's lemma) and for the case of two variables, under the assumption that the dynamical version of Lehmer's question is true.


title: Double Dimer Covers on Snake Graphs from Super Cluster Expansions

abstract: In a recent paper, the authors gave combinatorial formulas for the Laurent expansions of super $\lambda$-lengths in a marked disk, generalizing Schiffler's $T$-path formula. In the present paper, we give an alternate combinatorial expression for these super $\lambda$-lengths in terms of double dimer covers on snake graphs. This generalizes the dimer formulas of Musiker, Schiffler, and Williams.


title: Gravitational instantons with quadratic volume growth

abstract: There are two known classes of gravitational instantons with quadratic volume growth at infinity, known as type ALG and ALG$^*$. Gravitational instantons of type ALG were previously classified by Chen-Chen. In this paper, we prove a classification theorem for ALG$^*$ gravitational instantons. We determine the topology and prove existence of "uniform" coordinates at infinity for both ALG and ALG$^*$ gravitational instantons. We also prove a result regarding the relationship between ALG gravitational instantons of order $\mathfrak{n}$ and those of order $2$.


title: Transmission of coherent information at the onset of interactions

abstract: In this work, we investigate the parameters governing the rate at which a quantum channel arises at the onset of an interaction between two systems, $A$ and $B$. In particular, when system $A$ is pre-entangled with an ancilla, $\tilde{A}$, we quantify the early-time transmission of pre-existing entanglement by calculating the leading order change in coherent information of the complementary channel ($A\rightarrow B'$). We show that, when $A$ and $B$ are initially unentangled and $B$ is pure, there is no change in coherent information to first order, while the leading (second) order change is divergent. However, this divergence may be regulated by embedding the conventional notion of coherent information into what we call the family of $n$-coherent informations, defined using $n$-R\'enyi entropies. We find that the rate of change of the $n$-coherent information at the onset of the interaction is governed by a quantity, which we call the $n$-exposure, which captures the extent to which the initial coherent information of $A$ with $\tilde{A}$ is exposed to or `seen by' the interaction Hamiltonian between $A$ and $B$. We give examples in qubit systems and in the light-matter interaction.


title: Differentially Private Fine-tuning of Language Models

abstract: We give simpler, sparser, and faster algorithms for differentially private fine-tuning of large-scale pre-trained language models, which achieve the state-of-the-art privacy versus utility tradeoffs on many standard NLP tasks. We propose a meta-framework for this problem, inspired by the recent success of highly parameter-efficient methods for fine-tuning. Our experiments show that differentially private adaptations of these approaches outperform previous private algorithms in three important dimensions: utility, privacy, and the computational and memory cost of private training. On many commonly studied datasets, the utility of private models approaches that of non-private models. For example, on the MNLI dataset we achieve an accuracy of $87.8\%$ using RoBERTa-Large and $83.5\%$ using RoBERTa-Base with a privacy budget of $\epsilon = 6.7$. In comparison, absent privacy constraints, RoBERTa-Large achieves an accuracy of $90.2\%$. Our findings are similar for natural language generation tasks. Privately fine-tuning with DART, GPT-2-Small, GPT-2-Medium, GPT-2-Large, and GPT-2-XL achieve BLEU scores of 38.5, 42.0, 43.1, and 43.8 respectively (privacy budget of $\epsilon = 6.8,\delta=$ 1e-5) whereas the non-private baseline is $48.1$. All our experiments suggest that larger models are better suited for private fine-tuning: while they are well known to achieve superior accuracy non-privately, we find that they also better maintain their accuracy when privacy is introduced.


title: Spatial Data Augmentation with Simulated Room Impulse Responses for Sound Event Localization and Detection

abstract: Recording and annotating real sound events for a sound event localization and detection (SELD) task is time consuming, and data augmentation techniques are often favored when the amount of data is limited. However, how to augment the spatial information in a dataset, including unlabeled directional interference events, remains an open research question. Furthermore, directional interference events make it difficult to accurately extract spatial characteristics from target sound events. To address this problem, we propose an impulse response simulation framework (IRS) that augments spatial characteristics using simulated room impulse responses (RIR). RIRs corresponding to a microphone array assumed to be placed in various rooms are accurately simulated, and the source signals of the target sound events are extracted from a mixture. The simulated RIRs are then convolved with the extracted source signals to obtain an augmented multi-channel training dataset. Evaluation results obtained using the TAU-NIGENS Spatial Sound Events 2021 dataset show that the IRS contributes to improving the overall SELD performance. Additionally, we conducted an ablation study to discuss the contribution and need for each component within the IRS.


title: Prompt-tuning in ASR systems for efficient domain-adaptation

abstract: Automatic Speech Recognition (ASR) systems have found their use in numerous industrial applications in very diverse domains. Since domain-specific systems perform better than their generic counterparts on in-domain evaluation, the need for memory and compute-efficient domain adaptation is obvious. Particularly, adapting parameter-heavy transformer-based language models used for rescoring ASR hypothesis is challenging. In this work, we overcome the problem using prompt-tuning, a methodology that trains a small number of domain token embedding parameters to prime a transformer-based LM to a particular domain. With just a handful of extra parameters per domain, we achieve much better perplexity scores over the baseline of using an unadapted LM. Despite being parameter-efficient, these improvements are comparable to those of fully-fine-tuned models with hundreds of millions of parameters. We replicate our findings in perplexity numbers to Word Error Rate in a domain-specific ASR system for one such domain.


title: Electric-field control of magnetic anisotropies: applications to Kitaev spin liquids and topological spin textures

abstract: Magnetic anisotropies often originate from the spin-orbit coupling and determine magnetic ordering patterns. We develop a microscopic theory for DC electric-field controls of magnetic anisotropies in magnetic Mott insulators and discuss its applications to Kitaev materials and topological spin textures. Throughout this paper, we take a microscopic approach based on Hubbard-like lattice models, tight-binding models with on-site interactions. We derive a low-energy spin Hamiltonian from a fourth-order perturbation expansion of the Hubbard-like model. We show in the presence of a strong intra-atomic spin-orbit coupling that DC electric fields add non-Kitaev interactions such as a Dzyaloshinskii-Moriya interaction and an off-diagonal $\Gamma'$ interaction to the Kitaev-Heisenberg model and can induce a topological quantum phase transition between Majorana Chern insulating phases. We also investigate the inter-atomic Rashba spin-orbit coupling and its effects on topological spin textures. DC electric fields turn out to create and annihilate magnetic skyrmions, hedgehogs, and chiral solitons. We propose several methods of creating topological spin textures with external electromagnetic fields. Our theory clarifies that the strong but feasible electric field can control Kitaev spin liquids and topological spin textures.


title: Path-Free Decomposition for Direct, Indirect and Interaction Effects in Mediation Analysis

abstract: Given a binary treatment and a binary mediator, mediation analysis decomposes the total effect of the treatment on an outcome variable into direct and indirect effects. However, the existing decompositions are "path-dependent", and consequently, there appeared different versions of direct and indirect effects. Differently from these, this paper proposes a "path-free" decomposition of the total effect into three sub-effects: direct, indirect, and treatment-mediator interaction effects. Whereas the interaction effect has been part of the indirect effect in the existing two-effect decompositions, it is separately identified in our three-effect decomposition. All effects are found using conditional means, but not conditional densities, and are estimated with ordinary least squares estimators. Simulation and empirical analyses are provided as well.


title: Possible modification to standard cosmological model to resolve tension with Hubble constant values

abstract: The tensions between the values of Hubble constant obtained from the early and the late Universe data pose a significant challenge to modern cosmology. Possible modifications of the flat homogeneous isotropic cosmological {\Lambda}CDM model are considered, in which the Universe contains dark energy, cold baryonic matter and dark matter. They are based on general relativity and satisfy two requirements: (1) the value of the Hubble constant, calculated from the value of the Hubble parameter at the recombination by the formulas of flat {\Lambda}CDM model, should be equal to 92% of the one based on low-reshift observations; (2) deviations from the {\Lambda}CDM model should not lead to effects that contradict astronomical observations and estimations obtained thereof. The analysis showed that there are few opportunities for choice. Either we should consider DM with negative pressure -\r{ho}_{dm}c^2<<p_{dm}<0, which weakly affects the evolution of the Universe and the observed manifestations of DM, or we should admit the mechanism of generation of new matter, for example, by a decay of DE.


title: New allocation rule of directed hypergraphs

abstract: The Shapley value, one of the well-known allocation rules in game theory, does not take into account information about the structure of the graph, so by using the Shapley value for each hyperedge, we introduce a new allocation rule by considering their first-order combination. We proved that some of the properties that hold for Shapley and Myerson values also hold for our allocation rule. In addition, we found the relationship between our allocation rule and the Forman curvature, which plays an important role in discrete geometry.


title: Perception Point: Identifying Critical Learning Periods in Speech for Bilingual Networks

abstract: Recent studies in speech perception have been closely linked to fields of cognitive psychology, phonology, and phonetics in linguistics. During perceptual attunement, a critical and sensitive developmental trajectory has been examined in bilingual and monolingual infants where they can best discriminate common phonemes. In this paper, we compare and identify these cognitive aspects on deep neural-based visual lip-reading models. We conduct experiments on the two most extensive public visual speech recognition datasets for English and Mandarin. Through our experimental results, we observe a strong correlation between these theories in cognitive psychology and our unique modeling. We inspect how these computational models develop similar phases in speech perception and acquisitions.


title: Efficiency in the Serverless Cloud Paradigm: A Survey on the Reusing and Approximation Aspects

abstract: Serverless computing along with Function-as-a-Service (FaaS) is forming a new computing paradigm that is anticipated to found the next generation of cloud systems. The popularity of this paradigm is due to offering a highly transparent infrastructure that enables user applications to scale in the granularity of their functions. Since these often small and single-purpose functions are managed on shared computing resources behind the scene, a great potential for computational reuse and approximate computing emerges that if unleashed, can remarkably improve the efficiency of serverless cloud systems -- both from the user's QoS and system's (energy consumption and incurred cost) perspectives. Accordingly, the goal of this survey study is to, first, unfold the internal mechanics of serverless computing and, second, explore the scope for efficiency within this paradigm via studying function reuse and approximation approaches and discussing the pros and cons of each one. Next, we outline potential future research directions within this paradigm that can either unlock new use cases or make the paradigm more efficient.


title: Learning Stable Koopman Embeddings

abstract: In this paper, we present a new data-driven method for learning stable models of nonlinear systems. Our model lifts the original state space to a higher-dimensional linear manifold using Koopman embeddings. Interestingly, we prove that every discrete-time nonlinear contracting model can be learnt in our framework. Another significant merit of the proposed approach is that it allows for unconstrained optimization over the Koopman embedding and operator jointly while enforcing stability of the model, via a direct parameterization of stable linear systems, greatly simplifying the computations involved. We validate our method on a simulated system and analyze the advantages of our parameterization compared to alternatives.


title: The Dawn of Quantum Natural Language Processing

abstract: In this paper, we discuss the initial attempts at boosting understanding human language based on deep-learning models with quantum computing. We successfully train a quantum-enhanced Long Short-Term Memory network to perform the parts-of-speech tagging task via numerical simulations. Moreover, a quantum-enhanced Transformer is proposed to perform the sentiment analysis based on the existing dataset.


title: First excited state with moderate rank distribution

abstract: Evidence is provided for the existence of infinite periodic sequences of Schur sigma-groups G with commutator quotient G/G' ~ C(3^e) x C(3), e >= 7, and logarithmic order lo(G) = 10+e. With respect to their maximal subgroups H1,H2,H3;H4, they have moderate rank distribution rho(G) = (rank3(Hi/Hi')) ~ (2,2,3;3) and represent the first excited state of their punctured transfer kernel types kappa(G), which is characterized by a polarized component, e33 or (e+1)32, of the abelian quotient invariants alpha(G) = (Hi/Hi') with lo = 6+e in contrast to the ground state with lo = 4+e.


title: MedNet: Pre-trained Convolutional Neural Network Model for the Medical Imaging Tasks

abstract: Deep Learning (DL) requires a large amount of training data to provide quality outcomes. However, the field of medical imaging suffers from the lack of sufficient data for properly training DL models because medical images require manual labelling carried out by clinical experts thus the process is time-consuming, expensive, and error-prone. Recently, transfer learning (TL) was introduced to reduce the need for the annotation procedure by means of transferring the knowledge performed by a previous task and then fine-tuning the result using a relatively small dataset. Nowadays, multiple classification methods from medical imaging make use of TL from general-purpose pre-trained models, e.g., ImageNet, which has been proven to be ineffective due to the mismatch between the features learned from natural images (ImageNet) and those more specific from medical images especially medical gray images such as X-rays. ImageNet does not have grayscale images such as MRI, CT, and X-ray. In this paper, we propose a novel DL model to be used for addressing classification tasks of medical imaging, called MedNet. To do so, we aim to issue two versions of MedNet. The first one is Gray-MedNet which will be trained on 3M publicly available gray-scale medical images including MRI, CT, X-ray, ultrasound, and PET. The second version is Color-MedNet which will be trained on 3M publicly available color medical images including histopathology, taken images, and many others. To validate the effectiveness MedNet, both versions will be fine-tuned to train on the target tasks of a more reduced set of medical images. MedNet performs as the pre-trained model to tackle any real-world application from medical imaging and achieve the level of generalization needed for dealing with medical imaging tasks, e.g. classification. MedNet would serve the research community as a baseline for future research.


title: Benchmarking the Robustness of Spatial-Temporal Models Against Corruptions

abstract: The state-of-the-art deep neural networks are vulnerable to common corruptions (e.g., input data degradations, distortions, and disturbances caused by weather changes, system error, and processing). While much progress has been made in analyzing and improving the robustness of models in image understanding, the robustness in video understanding is largely unexplored. In this paper, we establish a corruption robustness benchmark, Mini Kinetics-C and Mini SSV2-C, which considers temporal corruptions beyond spatial corruptions in images. We make the first attempt to conduct an exhaustive study on the corruption robustness of established CNN-based and Transformer-based spatial-temporal models. The study provides some guidance on robust model design and training: Transformer-based model performs better than CNN-based models on corruption robustness; the generalization ability of spatial-temporal models implies robustness against temporal corruptions; model corruption robustness (especially robustness in the temporal domain) enhances with computational cost and model capacity, which may contradict the current trend of improving the computational efficiency of models. Moreover, we find the robustness intervention for image-related tasks (e.g., training models with noise) may not work for spatial-temporal models.


title: Convexity of sets and quadratic functions on the hyperbolic space

abstract: In this paper some concepts of convex analysis on hyperbolic space are studied. We first study properties of the intrinsic distance, for instance, we present the spectral decomposition of its Hessian. Next, we study the concept of convex sets and the intrinsic projection onto these sets. We also study the concept of convex functions and present first and second order characterizations of these functions, as well as some optimization concepts related to them. An extensive study of the hyperbolically convex quadratic functions is also presented.


title: Diode pumped silicate fiber for visible laser emission

abstract: We demonstrate yellow laser emission using silicate glass fiber as the gain medium. By employing core pumping using widely available GaN diode lasers with emission at 445 nm, we show that Dy3+-doped aluminosilicate glass fiber can be readily excited creating sufficient gain at 581 nm. In this proof of concept demonstration, the maximum output power generated was 3 mW with a slope efficiency approximately 1.8% with respect to injected pump.


title: 2D Multi-Class Model for Gray and White Matter Segmentation of the Cervical Spinal Cord at 7T

abstract: The spinal cord (SC), which conveys information between the brain and the peripheral nervous system, plays a key role in various neurological disorders such as multiple sclerosis (MS) and amyotrophic lateral sclerosis (ALS), in which both gray matter (GM) and white matter (WM) may be impaired. While automated methods for WM/GM segmentation are now largely available, these techniques, developed for conventional systems (3T or lower) do not necessarily perform well on 7T MRI data, which feature finer details, contrasts, but also different artifacts or signal dropout. The primary goal of this study is thus to propose a new deep learning model that allows robust SC/GM multi-class segmentation based on ultra-high resolution 7T T2*-w MR images. The second objective is to highlight the relevance of implementing a specific data augmentation (DA) strategy, in particular to generate a generic model that could be used for multi-center studies at 7T.


title: Statistical-mechanical analysis of adaptive filter with clipping saturation-type nonlinearity

abstract: In most practical adaptive signal processing systems, e.g., active noise control, active vibration control, and acoustic echo cancellation, substantial nonlinearities that cannot be neglected exist. In this paper, we analyze the behaviors of an adaptive system in which the output of the adaptive filter has the clipping saturation-type nonlinearity by a statistical-mechanical method. We discuss the dynamical and steady-state behaviors of the adaptive system by asymptotic analysis, steady-state analysis, and numerical calculation. As a result, it has become clear that the saturation value has the critical point at which the system's mean-square stability and instability switch. The obtained theory well explains the strange behaviors around the critical point observed in the computer simulation. Finally, the exact value of the critical point is also derived.


title: Universal enveloping algebra of a pair of compatible Lie brackets

abstract: Applying the Poincare-Birkhoff-Witt property and the Groebner-Shirshov bases technique, we find the linear basis of the associative universal enveloping algebra in the sense of V. Ginzburg and M. Kapranov of a pair of compatible Lie brackets. We state that the growth rate of this universal enveloping over $n$-dimensional compatible Lie algebra equals $n+1$.


title: Nonmonotonic magnetic field dependence of remanent ferroelectric polarization in reduced-graphene-oxide-BiFeO$_3$ nanocomposite

abstract: In a nanocomposite of reduced graphene oxide (RGO) and BiFeO$_3$ (BFO), the remanent ferroelectric polarization is found to follow nonmonotonic magnetic field dependence at room temperature as the applied magnetic field is swept across 0-20 kOe on a pristine sample. The remanent ferroelectric polarization is determined both from direct electrical measurements on an assembly of nanoparticles and powder neutron diffraction patterns recorded under 0-20 kOe field. The nanosized ($\sim$20 nm) particles of BFO are anchored onto the graphene sheets of RGO via Fe-C bonds with concomitant rise in covalency in the Fe-O bonds. The field-dependent competition between the positive and negative magnetoelectric coupling arising from magnetostriction due to, respectively, interface and bulk magnetization appears to be giving rise to the observed nonmonotonic field dependence of polarization. The emergence of Fe-C bonds and consequent change in the magnetic and electronic structure of the interface region has influenced the coupling between ferroelectric and magnetic properties remarkably and thus creates a new way of tuning the magnetoelectric properties via reconstruction of interfaces in nanocomposites or heterostructures of graphene/single-phase-multiferroic systems.


title: Impacts of Device Caching of Content Fractions on Expected Content Quality

abstract: This paper explores caching of fractions of a video content, not caching of an entire content, to increase the expected video quality. We first show that the highest-quality content is better to be cached and propose the caching policy of video chunks having different qualities. Our caching policy utilizes the characteristics of video contents that video files can be encoded into multiple versions with different qualities, each file consists of many chunks, and chunks can have different qualities. Extensive performance evaluations are conducted to show that caching of content fractions, rather than an entire content, can improve the expected video quality especially when the channel conditions is sufficiently good to cooperate with nearby BS or helpers.