title: Neural Graph Matching Network: Learning Lawler's Quadratic Assignment Problem with Extension to Hypergraph and Multiple-graph Matching

abstract: Graph matching involves combinatorial optimization based on edge-to-edge affinity matrix, which can be generally formulated as Lawler's Quadratic Assignment Problem (QAP). This paper presents a QAP network directly learning with the affinity matrix (equivalently the association graph) whereby the matching problem is translated into a constrained vertex classification task. The association graph is learned by an embedding network for vertex classification, followed by Sinkhorn normalization and a cross-entropy loss for end-to-end learning. We further improve the embedding model on association graph by introducing Sinkhorn based matching-aware constraint, as well as dummy nodes to deal with unequal sizes of graphs. To our best knowledge, this is one of the first network to directly learn with the general Lawler's QAP. In contrast, recent deep matching methods focus on the learning of node/edge features in two graphs respectively. We also show how to extend our network to hypergraph matching, and matching of multiple graphs. Experimental results on both synthetic graphs and real-world images show its effectiveness. For pure QAP tasks on synthetic data and QAPLIB benchmark, our method can perform competitively and even surpass state-of-the-art graph matching and QAP solvers with notable less time cost. We provide a project homepage at http://thinklab.sjtu.edu.cn/project/NGM/index.html.


title: Drivers affecting cloud ERP deployment decisions: an Australian study

abstract: Cloud-based Enterprise Resources Planning (Cloud ERP) is hosting an ERP system through the cloud environment. Cloud ERP is responsible for organisational business processes such as purchasing, financial, and human resource by providing a real-time infrastructure for the enterprise. With the development of technology, cloud ERP is noticed by more and more enterprises. Currently, limited researches have been conducted for cloud ERP systems in the Australian context. Furthermore, no studies have indicated how different perspectives (client company & consultant company) bring insights into the deployment decisions on cloud ERP. Hence, this research intends to understand drivers affecting cloud ERP deployment decisions from both the client company and the consultant company perspective in an Australian context. This paper identifies 31 relevant literature on cloud ERP adoption; 79 critical drivers affecting cloud ERP deployment decisions were identified from the selected literature, and those drivers are then categorized using the Technology-Organisation-Environment (TOE) framework to develop the initial theoretical model. By conducting a Case Study Approach using a semi-structured interview and secondary resources analysis, findings are then compared to the theoretical model. As a result, an empirically validated model on drivers affecting cloud ERP deployment decisions from both client company and consultant company perspectives has been developed; this model contains 15 drivers and 7 of them are new. The theoretical and practical contributions of the findings are then outlined.


title: Higher-order topological insulators in synthetic dimensions

abstract: Conventional topological insulators support boundary states that have one dimension lower than the bulk system that hosts them, and these states are topologically protected due to quantized bulk dipole moments. Recently, higher-order topological insulators have been proposed as a way of realizing topological states that are two or more dimensions lower than the bulk, due to the quantization of bulk quadrupole or octupole moments. However, all these proposals as well as experimental realizations have been restricted to real-space dimensions. Here we construct photonic higher-order topological insulators (PHOTI) in synthetic dimensions. We show the emergence of a quadrupole PHOTI supporting topologically protected corner modes in an array of modulated photonic molecules with a synthetic frequency dimension, where each photonic molecule comprises two coupled rings. By changing the phase difference of the modulation between adjacently coupled photonic molecules, we predict a dynamical topological phase transition in the PHOTI. Furthermore, we show that the concept of synthetic dimensions can be exploited to realize even higher-order multipole moments such as a 4th order hexadecapole (16-pole) insulator, supporting 0D corner modes in a 4D hypercubic synthetic lattice that cannot be realized in real-space lattices.


title: Ultrastrong coupling between a microwave resonator and antiferromagnetic resonances of rare earth ion spins

abstract: Quantum magnonics is a new and active research field, leveraging the strong collective coupling between microwaves and magnetically ordered spin systems. To date work in quantum magnonics has focused on transition metals and almost entirely on ferromagnetic resonances in yttrium iron garnet (YIG). Antiferromagnetic systems have gained interest as they produce no stray field, and are therefore robust to magnetic perturbations and have narrow, shape independent resonant linewidths. Here we show the first experimental evidence of ultrastrong-coupling between a microwave cavity and collective antiferromagnetic resonances (magnons) in a rare earth crystal. The combination of the unique optical and spin properties of the rare earths and collective antiferromagnetic order paves the way for novel quantum magnonic applications.


title: Spatial-Aware GAN for Unsupervised Person Re-identification

abstract: The recent person re-identification research has achieved great success by learning from a large number of labeled person images. On the other hand, the learned models often experience significant performance drops when applied to images collected in a different environment. Unsupervised domain adaptation (UDA) has been investigated to mitigate this constraint, but most existing systems adapt images at pixel level only and ignore obvious discrepancies at spatial level. This paper presents an innovative UDA-based person re-identification network that is capable of adapting images at both spatial and pixel levels simultaneously. A novel disentangled cycle-consistency loss is designed which guides the learning of spatial-level and pixel-level adaptation in a collaborative manner. In addition, a novel multi-modal mechanism is incorporated which is capable of generating images of different geometry views and augmenting training images effectively. Extensive experiments over a number of public datasets show that the proposed UDA network achieves superior person re-identification performance as compared with the state-of-the-art.


title: Summarizing CPU and GPU Design Trends with Product Data

abstract: Moore's Law and Dennard Scaling have guided the semiconductor industry for the past few decades. Recently, both laws have faced validity challenges as transistor sizes approach the practical limits of physics. We are interested in testing the validity of these laws and reflect on the reasons responsible. In this work, we collect data of more than 4000 publicly-available CPU and GPU products. We find that transistor scaling remains critical in keeping the laws valid. However, architectural solutions have become increasingly important and will play a larger role in the future. We observe that GPUs consistently deliver higher performance than CPUs. GPU performance continues to rise because of increases in GPU frequency, improvements in the thermal design power (TDP), and growth in die size. But we also see the ratio of GPU to CPU performance moving closer to parity, thanks to new SIMD extensions on CPUs and increased CPU core counts.


title: Calibrated Domain-Invariant Learning for Highly Generalizable Large Scale Re-Identification

abstract: Many real-world applications, such as city-scale traffic monitoring and control, requires large-scale re-identification. However, previous ReID methods often failed to address two limitations in existing ReID benchmarks, i.e., low spatiotemporal coverage and sample imbalance. Notwithstanding their demonstrated success in every single benchmark, they have difficulties in generalizing to unseen environments. As a result, these methods are less applicable in a large-scale setting due to poor generalization. In seek for a highly generalizable large-scale ReID method, we present an adversarial domain invariant feature learning framework (ADIN) that explicitly learns to separate identity-related features from challenging variations, where for the first time "free" annotations in ReID data such as video timestamp and camera index are utilized. Furthermore, we find that the imbalance of nuisance classes jeopardizes the adversarial training, and for mitigation we propose a calibrated adversarial loss that is attentive to nuisance distribution. Experiments on existing large-scale person vehicle ReID datasets demonstrate that ADIN learns more robust and generalizable representations, as evidenced by its outstanding direct transfer performance across datasets, which is a criterion that can better measure the generalizability of large-scale ReID methods/


title: Nonuniversal transition to condensate formation in two-dimensional turbulence

abstract: The occurrence of system-scale coherent structures, so-called condensates, is a well-known phenomenon in two-dimensional turbulence. Here, the transition to condensate formation is investigated as a function of the magnitude of the force and for different types of forcing. Random forces with constant mean energy input lead to a supercritical transition, while forcing through a small-scale linear instability results in a subcritical transition with bistability and hysteresis. That is, the transition to condensate formation in two-dimensional turbulence is nonuniversal. For the supercritical case we quantify the effect of large-scale friction on the value of the critical exponent and the location of the critical point.


title: Harmonic analysis for rank-1 Randomised Horn Problems

abstract: The randomised Horn problem, in both its additive and multiplicative version, has recently drawn increasing interest. Especially, closed analytical results have been found for the rank-1 perturbation of sums of Hermitian matrices and products of unitary matrices. We will generalise these results to rank-1 perturbations for products of positive definite Hermitian matrices and prove the other results in a new unified way. Our ideas work along harmonic analysis for matrix groups via spherical transforms that have been successfully applied in products of random matrices in the past years. In order to achieve the unified derivation of all three cases, we define the spherical transform on the unitary group and prove its invertibility.


title: Fault-tolerant Compass Codes

abstract: We study a class of gauge fixings of the Bacon-Shor code at the circuit level, which includes a subfamily of generalized surface codes. We show that for these codes, fault tolerance can be achieved by direct measurements of the stabilizers. By simulating our fault-tolerant scheme under biased noise, we show the possibility of optimizing the performance of the surface code by stretching the bulk stabilizer geometry. To decode the syndrome efficiently and accurately, we generalize the union-find decoder to biased noise models. Our decoder obtains a $0.83\%$ threshold value for the surface code in quadratic time complexity.


title: Gravitational Waves from Hierarchical Triple Systems with Kozai-Lidov Oscillation

abstract: We study gravitational waves from a hierarchical three-body system up to first-order postNewtonian approximation. Under certain conditions, the existence of a nearby third body can cause periodic exchange between eccentricity of an inner binary and relative inclination, known as Kozai-Lidov oscillations. We analyze features of the waveform from the inner binary system undergoing such oscillations. We find that variation caused due to the tertiary companion can be observed in the gravitational waveforms and energy spectra, which should be compared with those from isolated binaries and coplanar three-body system. The detections from future space interferometers will make possible the investigation of the gravitational wave spectrum in mHz range and may fetch signals by sources addressed.


title: Learning Efficient Video Representation with Video Shuffle Networks

abstract: 3D CNN shows its strong ability in learning spatiotemporal representation in recent video recognition tasks. However, inflating 2D convolution to 3D inevitably introduces additional computational costs, making it cumbersome in practical deployment. We consider whether there is a way to equip the conventional 2D convolution with temporal vision no requiring expanding its kernel. To this end, we propose the video shuffle, a parameter-free plug-in component that efficiently reallocates the inputs of 2D convolution so that its receptive field can be extended to the temporal dimension. In practical, video shuffle firstly divides each frame feature into multiple groups and then aggregate the grouped features via temporal shuffle operation. This allows the following 2D convolution aggregate the global spatiotemporal features. The proposed video shuffle can be flexibly inserted into popular 2D CNNs, forming the Video Shuffle Networks (VSN). With a simple yet efficient implementation, VSN performs surprisingly well on temporal modeling benchmarks. In experiments, VSN not only gains non-trivial improvements on Kinetics and Moments in Time, but also achieves state-of-the-art performance on Something-Something-V1, Something-Something-V2 datasets.


title: Modeling and design optimization for pleated membrane filters

abstract: Pleated membrane filters, which offer larger surface area to volume ratios than unpleated membrane filters, are used in a wide variety of applications. However, the performance of the pleated filter, as characterized by a flux-throughput plot, indicates that the equivalent unpleated filter provides better performance under the same pressure drop. Earlier work (Sanaei & Cummings 2016) used a highly-simplified membrane model to investigate how the pleating effect and membrane geometry affect this performance differential. In this work, we extend this line of investigation and use asymptotic methods to couple an outer problem for the flow within the pleated structure to an inner problem that accounts for the pore structure within the membrane. We use our new model to formulate and address questions of optimal membrane design for a given filtration application.


title: An Efficient Algorithm for Interfacial Statistical Associating Fluid (iSAFT) in Cylindrical Geometry

abstract: In this work we present an efficient numerical algorithm for the solution of interfacial statistical associating fluid theory (iSAFT) in cylindrical geometry to facilitate the study of inhomogeneous fluids having curvatures. The new solution algorithm is shown to have a better time scaling than the elliptic function method by Malijevsky, and the transform method by Lado. Convergence, performance, and stability of the numerical algorithm are discussed. We showcase two representative applications of the new method for modeling fluid adsorption and bottlebrush polymers. By comparing iSAFT with molecular simulation results, we found that iSAFT predicts layering transitions above the triple point for methane adsorption, and it captures power-law to parabolic transitions for polymers brush microstructure. We conclude that the continuous development of solution algorithm for iSAFT enables researchers to investigate curvature effects for fluids in efficient manners.


title: Effective Decoding in Graph Auto-Encoder using Triadic Closure

abstract: The (variational) graph auto-encoder and its variants have been popularly used for representation learning on graph-structured data. While the encoder is often a powerful graph convolutional network, the decoder reconstructs the graph structure by only considering two nodes at a time, thus ignoring possible interactions among edges. On the other hand, structured prediction, which considers the whole graph simultaneously, is computationally expensive. In this paper, we utilize the well-known triadic closure property which is exhibited in many real-world networks. We propose the triad decoder, which considers and predicts the three edges involved in a local triad together. The triad decoder can be readily used in any graph-based auto-encoder. In particular, we incorporate this to the (variational) graph auto-encoder. Experiments on link prediction, node clustering and graph generation show that the use of triads leads to more accurate prediction, clustering and better preservation of the graph characteristics.


title: Progressive Retinex: Mutually Reinforced Illumination-Noise Perception Network for Low Light Image Enhancement

abstract: Contrast enhancement and noise removal are coupled problems for low-light image enhancement. The existing Retinex based methods do not take the coupling relation into consideration, resulting in under or over-smoothing of the enhanced images. To address this issue, this paper presents a novel progressive Retinex framework, in which illumination and noise of low-light image are perceived in a mutually reinforced manner, leading to noise reduction low-light enhancement results. Specifically, two fully pointwise convolutional neural networks are devised to model the statistical regularities of ambient light and image noise respectively, and to leverage them as constraints to facilitate the mutual learning process. The proposed method not only suppresses the interference caused by the ambiguity between tiny textures and image noises, but also greatly improves the computational efficiency. Moreover, to solve the problem of insufficient training data, we propose an image synthesis strategy based on camera imaging model, which generates color images corrupted by illumination-dependent noises. Experimental results on both synthetic and real low-light images demonstrate the superiority of our proposed approaches against the State-Of-The-Art (SOTA) low-light enhancement methods.


title: Tracing State-Level Obesity Prevalence from Sentence Embeddings of Tweets: A Feasibility Study

abstract: Twitter data has been shown broadly applicable for public health surveillance. Previous public health studies based on Twitter data have largely relied on keyword-matching or topic models for clustering relevant tweets. However, both methods suffer from the short-length of texts and unpredictable noise that naturally occurs in user-generated contexts. In response, we introduce a deep learning approach that uses hashtags as a form of supervision and learns tweet embeddings for extracting informative textual features. In this case study, we address the specific task of estimating state-level obesity from dietary-related textual features. Our approach yields an estimation that strongly correlates the textual features to government data and outperforms the keyword-matching baseline. The results also demonstrate the potential of discovering risk factors using the textual features. This method is general-purpose and can be applied to a wide range of Twitter-based public health studies.


title: Kinematical Investigation of Possible Fast Collimated Outflows in Twelve Planetary Nebulae

abstract: A significant fraction of planetary nebulae (PNe) exhibit collimated outflows, distinct narrow kinematical components with notable velocity shifts with respect to the main nebular shells typically associated with low-ionization compact knots and linear or precessing jet-like features. We present here a spatio-kinematical investigation of a sample of twelve PNe with morphologies in emission lines of low-ionization species suggestive of collimated outflows. Using archival narrow-band images and our own high-dispersion long-slit echelle spectra, we confirm the presence of collimated outflows in Hen 2-429, J 320, M 1-66, M 2-40, M 3-1, and NGC 6210 and possibly in NGC 6741, for which the spatio-kinematical data can also be interpreted as a pair of bipolar lobes. The presence of collimated outflows is rejected in Hen 2-47, Hen 2-115, M 1-26, and M 1-37, but their morphology and kinematics are indicative of the action of supersonic outflows that have not been able to pierce through the nebular envelope. In this sense, M 1-66 appears to have experienced a similar interaction between the outflow and nebular envelope, but, as opposed to these four PNe, the outflow has been able to break through the nebular envelope. It is suggested that the PNe without collimated outflows in our sample are younger or descend from lower mass progenitors than those that exhibit unambiguous collimated outflows.


title: Simplified calcium signaling cascade for synaptic plasticity

abstract: We propose a model for synaptic plasticity based on a calcium signaling cascade. The model simplifies the full signaling pathways from a calcium influx to the phosphorylation (potentiation) and dephosphorylation (depression) of glutamate receptors that are gated by fictive C1 and C2 catalysts, respectively. This model is based on tangible chemical reactions, including fictive catalysts, for long-term plasticity rather than the conceptual theories commonplace in various models, such as preset thresholds of calcium concentration. Our simplified model successfully reproduced the experimental synaptic plasticity induced by different protocols such as (i) a synchronous pairing protocol and (ii) correlated presynaptic and postsynaptic action potentials (APs). Further, the ocular dominance plasticity (or the experimental verification of the celebrated Bienenstock--Cooper--Munro theory) was reproduced by two model synapses that compete by means of back-propagating APs (bAPs). The key to this competition is synapse-specific bAPs with reference to bAP-boosting on the physiological grounds.


title: Anisotropic Bi2O2Se(Te) Monolayer: Realizing Ultra-High Carrier Mobility and Giant Electric Polarization in Two-Dimension

abstract: Here, we have identified the monolayer phase of Bi2O2Se as a promising two-dimensional semiconductor with ultra-high carrier mobility and giant electric polarization. Due to the strong reconstruction originated from the interlayer electrostatic force, we have applied structure prediction algorithms to explore the crystalline geometry of Bi2O2Se monolayer with the lowest total energy. Considering Se and Te belong to the same group, Bi2O2Te monolayer is also investigated based on a similar scheme. Further calculations suggest that the high carrier mobility is maintained in the monolayer phase and the moderate band gap will lead to the strong optical absorption in the visible light region. In particular, the electron mobility in Bi2O2Te can reach as high as 3610 cm2V-1s-1 at room temperature, which is almost ten times of conventional transition metal dichalcogenides (TMD) family. Because of the strong structural anisotropy, a remarkable spontaneous in-plane and out-of-plane electric polarization is additionally revealed along with significant piezoelectric properties, endowing them as promising candidates in the area of photovoltaic solar cells, optoelectronic materials and field effect transistors.


title: Some refinements of the partial $C^0$ estimate

abstract: Relying on the recent work of Liu-Sz\'ekelyhidi we give a weak asymptotic estimate for the Bergman kernels of polarized K\"ahler manifolds with Ricci lower bound and Sobolev constant upper bound. We will also give a simple proof for the partial $C^0$ estimate along the (generalized) K\"ahler-Ricci flow on Fano manifolds.


title: Index-Based Scheduling for Parallel State Machine Replication

abstract: State Machine Replication (SMR) is a fundamental approach to designing service with fault tolerance. However, its requirement for the deterministic execution of transactions often results in single-threaded replicas, which cannot fully exploit the multicore capabilities of today's processors. Therefore, parallel SMR has become a hot topic of recent research. The basic idea behind it is that independent transactions can be executed in parallel, while dependent transactions must be executed in their relative order to ensure consistency among replicas. The dependency detection of existing parallel SMR methods is mainly based on pairwise transaction comparison or batch comparison. These methods cannot simultaneously guarantee both effective detection and concurrent execution. Moreover, the scheduling process cannot execute concurrently, which introduces extra scheduling overhead as well. In order to further reduce scheduling overhead and ensure the parallel execution of transactions, we propose an efficient scheduler based on a specific index structure. The index is composed of a Bloom Filter and the associated transaction queues, which provides an efficient dependency detection and preserve necessary dependency information respectively. Based on the index structure, we further devise an elaborated concurrent scheduling process. The experimental results show that the proposed scheduler is more efficient, scalable and robust than the comparison methods.


title: The Lindblad and Redfield forms without secular approximation derived from Born-Markov master equation and their applications

abstract: In this paper we derive the Lindblad and Redfield forms with and without secular approximation from the Born-Markov master equation for open quantum systems. The spectral correlation tensor of bath (the Fourier transform of the bath correlation function) and then the coefficients in the two forms of the master equation are reevaluated according to the scheme in Ref.[Phys. Rev. A 99, 022118 (2019)]. They are complex numbers rather than the real numbers getting from traditional simplified methods. The dynamics of two models [one is an open three-level quantum system model, and the other is the model of phycoerythrin 545 (PE545) of modeling a photosynthesis reaction center] are studied by using the obtained equations. The non-secular Lindblad and Redfield equations with the complex coefficients predict almost the same dynamical results from the Born-Markov master equation. However, the results obtained from the traditional Lindblad and Redfield equations deviate the actual dynamics of the open quantum systems.


title: Object-unital groupoid graded modules

abstract: In a previous article (see \cite{CNP}), we introduced and analyzed ring-theoretic properties of object unital $\mathcal{G}$-graded rings $R$, where $\mathcal{G}$ is a groupoid. In the present article, we analyze the category $\grmod$ of unitary $\G$-graded modules over such rings. Following ideas developed earlier by one of the authors in \cite{lundstrom2004}, we analyze the forgetful functor $U \colon \grmod \to \rmod$ and aim to determine properties $\mathcal{P}$ for which the following implications are valid for modules $M$ in $\grmod$: $M$ is $\mathcal{P}$ $\Rightarrow$ $U(M)$ is $\mathcal{P}$; $U(M)$ is $\mathcal{P}$ $\Rightarrow$ $M$ is $\mathcal{P}$. Here we treat the cases when $\mathcal{P}$ is any of the properties: direct summand, projective, injective, free, simple and semisimple. Moreover, graded versions of results concerning classical module theory are established, as well as some structural properties related to the category $\grmod$.


title: A Fluid Limit for Processor-Sharing Queues Weighted by Functions of Remaining Amounts of Service

abstract: We study a single server queue under a processor-sharing type of scheduling policy, where the weights for determining the sharing are given by functions of each job's remaining service(processing) amount, and obtain a fluid limit for the scaled measure-valued system descriptors.


title: Modulating Super-Exchange Strength to Achieve Robust Ferromagnetic Couplings in Two-Dimensional Semiconductors

abstract: Low-dimensional semiconducting ferromagnets have attracted considerable attention due to their promising applications as nano-size spintronics. However, realizing robust ferromagnetic couplings that can survive at high temperature is restrained by two decisive factors: super-exchange couplings and anisotropy. Despite widely explored low-dimensional anisotropy, strengthening super-exchange couplings has rarely been investigated. Here, we found that ligands with lower electronegativity can strengthen ferromagnetic super-exchange couplings and further proposed the ligand modulation strategy to enhance the Curie temperature of low-dimensional ferromagnets. Based on the metallic CrX2 (X = S, Se, Te) family, substituting ligand atoms by halides can form stable semiconducting phase as CrSeCl, CrSeBr and CrTeBr. It is interesting to discover that, the nearest ferromagnetic super-exchange couplings can be strengthened when substituting ligands from S to Se and Te. Such evolution originates from the enhanced electron hopping integral and reduced energy intervals between d and p orbits. While the second nearest anti-ferromagnetic couplings are also benefitted due to delocalized p-p interactions. Finally, ligand modulation strategy is applied in other ferromagnetic monolayers, further verifying our theory and providing a fundamental understanding on controlling super-exchange couplings in low-dimension.


title: Graphene-mediated interaction between adsorbed impurities

abstract: Interaction between adsorbed atoms in graphene is studied using a combination of DFT and the path integral formalism. Our results reveal a complex non-monotonic interaction profile. We show that the strength and sign of the interaction are dictated by the arrangement of impurities, as well as the system doping. These findings can be used to interpret the complex behavior of impurities in experimentally realized systems, as well as other classes of impurities, such as C substitutions in graphene.


title: Unification of Aeolian and Fluvial Sediment Transport Rate from Granular Physics

abstract: One of the physically least understood characteristics of geophysical transport of sediments along sediment surfaces is the well known experimental observation that the sediment transport rate $Q$ is linearly dependent on the fluid shear stress $\tau$ applied onto the surface in air, but is nonlinearly dependent on $\tau$ in water. Using transport simulations for a wide range of driving conditions, we show that the scaling depends on the manner in which the kinetic fluctuation energy of transported particles is dissipated: via predominantly fluid drag and quasistatic contacts (linear) versus fluid drag and quasistatic and collisional contacts (nonlinear). We use this finding to derive a scaling law (asymptotically $Q\sim\tau^2$) in simultaneous agreement with measurements in water and air streams.

categories: cond-mat.soft physics.ao-ph physics.flu-dyn physics.geo-ph


title: Characterization of Age-related Microstructural Changes in Locus Coeruleus and Substantia Nigra Pars Compacta

abstract: Locus coeruleus (LC) and substantia nigra pars compacta (SNpc) degrade with normal aging, but not much is known regarding how these changes manifest in MRI images, or whether these markers predict aspects of cognition. Here, we use high-resolution diffusion-weighted MRI to investigate microstructural and compositional changes in LC and SNpc in young and aged cohorts, as well as their relationship with cognition. In LC, the older cohort exhibited a significant reduction in mean and radial diffusivity, but a significant increase in fractional anisotropy compared to the young cohort. We observed a significant correlation between the decrease in LC mean and radial diffusivities with delayed recall. This observation suggests that LC is involved in retaining cognitive abilities. In addition, we observed that iron deposition in SNpc occurs early in life and continues during normal aging. Since neuronal loss occurs in both LC and SNpc in Parkinson's disease, but occurs only in the LC in Alzheimer's disease, our results may lead to early stage imaging biomarkers for these diseases.


title: Contextual Combinatorial Conservative Bandits

abstract: The problem of multi-armed bandits (MAB) asks to make sequential decisions while balancing between exploitation and exploration, and have been successfully applied to a wide range of practical scenarios. Various algorithms have been designed to achieve a high reward in a long term. However, its short-term performance might be rather low, which is injurious in risk sensitive applications. Building on previous work of conservative bandits, we bring up a framework of contextual combinatorial conservative bandits. An algorithm is presented and a regret bound of $\tilde O(d^2+d\sqrt{T})$ is proven, where $d$ is the dimension of the feature vectors, and $T$ is the total number of time steps. We further provide an algorithm as well as regret analysis for the case when the conservative reward is unknown. Experiments are conducted, and the results validate the effectiveness of our algorithm.


title: Disagreement and Polarization in Two-Party Social Networks

abstract: We investigate disagreement and polarization in a social network with two polarizing sources of information. First, we define disagreement and polarization indices in two-party leader-follower models of opinion dynamics. We then give expressions for the indices in terms of a graph Laplacian. The expressions show a relationship between these quantities and the concepts of resistance distance and biharmonic distance. We next study the problem of designing the network so as to minimize disagreement and polarization. We give conditions for optimal disagreement and polarization, and further, we show that a linear combination of disagreement and polarization of the follower nodes is a convex function of the edge weights between followers. We propose algorithms to address some related continuous and discrete optimization problems and also present analytic results for some interesting examples.


title: Protecting quantum coherences from static noise and disorder

abstract: Quantum coherences are paramount resources for applications, such as quantum-enhanced light-harvesting or quantum computing, which are fragile against environmental noise. We here derive generalized quantum master equations using perturbation theory in order to describe the effective ensemble-averaged time-evolution of finite-size quantum systems subject to static noise on all time scales. We then analyse the time-evolution of the coherences under energy broadening noise in a variety of systems characterized by both short and long-range interactions, by strongly correlated and fully uncorrelated noise -- a single qubit, a lattice model with on-site disorder and a potential ladder, and bosons in a double-well potential with random interaction strength -- and show that couplings can partially protect the system from the ensemble-averaging induced loss of coherence. Our work suggests that suitably tuned couplings could be employed to counteract part of the dephasing detrimental to quantum applications. Conversely, tailored noise distributions can be utilized to reach target non-equilibrium quantum states.


title: One-directional thermal transport in densely aligned single-wall carbon nanotube films

abstract: Individual carbon nanotubes (CNTs) possess extremely high thermal conductivities. However, the thermal conductivities and their anisotropy of macroscopic assemblies of CNTs have so far remained small. Here, we report results of directional thermal transport measurements on a nearly-perfectly aligned CNT film fabricated via controlled vacuum filtration. We found the thermal conductivity to be 43 +- 2.2 W m^-1 K^-1 with a record-high thermal anisotropy of 500. From the temperature dependence of the thermal conductivity and its agreement with the atomistic phonon transport calculation, we conclude that the effect of intertube thermal resistance on heat conduction in the alignment direction is negligible because of the large contact area between CNTs. These observations thus represent ideal unidirectional thermal transport, i.e., the thermal conductivity of the film is determined solely by that of individual CNTs.


title: Super-Resolution for Practical Automated Plant Disease Diagnosis System

abstract: Automated plant diagnosis using images taken from a distance is often insufficient in resolution and degrades diagnostic accuracy since the important external characteristics of symptoms are lost. In this paper, we first propose an effective pre-processing method for improving the performance of automated plant disease diagnosis systems using super-resolution techniques. We investigate the efficiency of two different super-resolution methods by comparing the disease diagnostic performance on the practical original high-resolution, low-resolution, and super-resolved cucumber images. Our method generates super-resolved images that look very close to natural images with 4$\times$ upscaling factors and is capable of recovering the lost detailed symptoms, largely boosting the diagnostic performance. Our model improves the disease classification accuracy by 26.9% over the bicubic interpolation method of 65.6% and shows a small gap (3% lower) between the original result of 95.5%.


title: Spatial Modeling for Correlated Cancers Using Bivariate Directed Graphs

abstract: Disease maps are an important tool in cancer epidemiology used for the analysis of geographical variations in disease rates and the investigation of environmental risk factors underlying spatial patterns. Cancer maps help epidemiologists highlight geographic areas with high and low prevalence, incidence, or mortality rates of cancers, and the variability of such rates over a spatial domain. When more than one cancer is of interest, the models must also capture the inherent or endemic association between the diseases in addition to the spatial association. This article develops interpretable and easily implementable spatial autocorrelation models for two or more cancers. The article builds upon recent developments in univariate disease mapping that have shown the use of mathematical structures such as directed acyclic graphs to capture spatial association for a single cancer, estimating inherent or endemic association for two cancers in addition to the association over space (clustering) for each of the cancers. The method builds a Bayesian hierarchical model where the spatial effects are introduced as latent random effects for each cancer. We analyze the relationship between incidence rates of esophagus and lung cancer extracted from the Surveillance, Epidemiology, and End Results (SEER) Program. Our analysis shows statistically significant association between the county-wise incidence rates of lung and esophagus cancer across California. The bivariate directed acyclic graphical model performs better than competing bivariate spatial models in the existing literature.


title: An Autonomous Spectrum Management Scheme for Unmanned Aerial Vehicle Networks in Disaster Relief Operations

abstract: This paper studies the problem of spectrum shortage in an unmanned aerial vehicle (UAV) network during critical missions such as wildfire monitoring, search and rescue, and disaster monitoring. Such applications involve a high demand for high-throughput data transmissions such as real-time video-, image-, and voice- streaming where the assigned spectrum to the UAV network may not be adequate to provide the desired Quality of Service (QoS). In these scenarios, the aerial network can borrow an additional spectrum from the available terrestrial networks in the trade of a relaying service for them. We propose a spectrum sharing model in which the UAVs are grouped into two classes of relaying UAVs that service the spectrum owner and the sensing UAVs that perform the disaster relief mission using the obtained spectrum. The operation of the UAV network is managed by a hierarchical mechanism in which a central controller assigns the tasks of the UAVs based on their resources and determine their operation region based on the level of priority of impacted areas and then the UAVs autonomously fine-tune their position using a model-free reinforcement learning algorithm to maximize the individual throughput and prolong their lifetime. We analyze the performance and the convergence for the proposed method analytically and with extensive simulations in different scenarios.


title: Skeleton based Zero Shot Action Recognition in Joint Pose-Language Semantic Space

abstract: How does one represent an action? How does one describe an action that we have never seen before? Such questions are addressed by the Zero Shot Learning paradigm, where a model is trained on only a subset of classes and is evaluated on its ability to correctly classify an example from a class it has never seen before. In this work, we present a body pose based zero shot action recognition network and demonstrate its performance on the NTU RGB-D dataset. Our model learns to jointly encapsulate visual similarities based on pose features of the action performer as well as similarities in the natural language descriptions of the unseen action class names. We demonstrate how this pose-language semantic space encodes knowledge which allows our model to correctly predict actions not seen during training.


title: High Dimensional M-Estimation with Missing Outcomes: A Semi-Parametric Framework

abstract: We consider high dimensional $M$-estimation in settings where the response $Y$ is possibly missing at random and the covariates $\mathbf{X} \in \mathbb{R}^p$ can be high dimensional compared to the sample size $n$. The parameter of interest $\boldsymbol{\theta}_0 \in \mathbb{R}^d$ is defined as the minimizer of the risk of a convex loss, under a fully non-parametric model, and $\boldsymbol{\theta}_0$ itself is high dimensional which is a key distinction from existing works. Standard high dimensional regression and series estimation with possibly misspecified models and missing $Y$ are included as special cases, as well as their counterparts in causal inference using 'potential outcomes'. Assuming $\boldsymbol{\theta}_0$ is $s$-sparse ($s \ll n$), we propose an $L_1$-regularized debiased and doubly robust (DDR) estimator of $\boldsymbol{\theta}_0$ based on a high dimensional adaptation of the traditional double robust (DR) estimator's construction. Under mild tail assumptions and arbitrarily chosen (working) models for the propensity score (PS) and the outcome regression (OR) estimators, satisfying only some high-level conditions, we establish finite sample performance bounds for the DDR estimator showing its (optimal) $L_2$ error rate to be $\sqrt{s (\log d)/ n}$ when both models are correct, and its consistency and DR properties when only one of them is correct. Further, when both the models are correct, we propose a desparsified version of our DDR estimator that satisfies an asymptotic linear expansion and facilitates inference on low dimensional components of $\boldsymbol{\theta}_0$. Finally, we discuss various of choices of high dimensional parametric/semi-parametric working models for the PS and OR estimators. All results are validated via detailed simulations.


title: Extending the reach of FASER, MATHUSLA, and SHiP towards smaller lifetimes using secondary particle production

abstract: Many existing or proposed intensity-frontier search experiments look for decay signatures of light long-lived particles (LLPs), highly displaced from the interaction point, in a distant detector that is well-shielded from SM background. This approach is, however, limited to new particles with decay lengths similar to or larger than the baseline of those experiments. In this study, we discuss how this basic constraint can be overcome in BSM models that go beyond the simplest scenarios. If more than one light new particle is present in the model, an additional secondary production of LLPs may take place right in front of the detector, opening this way a new lifetime regime to be probed. We illustrate the prospects of such searches in the future experiments FASER, MATHUSLA and SHiP, for representative models, emphasizing possible connections to dark matter or an anomalous magnetic moment of muon. We also analyze additional advantages from employing dedicated neutrino detectors placed in front of the main decay volume.


title: Controller Synthesis of Wind Turbine Generator and Energy Storage System with Stochastic Wind Variations under Temporal Logic Specifications

abstract: In this paper, we present a controller synthesis approach for wind turbine generators (WTG) and energy storage systems with metric temporal logic (MTL) specifications, with provable probabilistic guarantees in the stochastic environment of wind power generation. The MTL specifications are requirements for the grid frequency deviations, WTG rotor speed variations and the power flow constraints at different lines. We present the stochastic control bisimulation function, which bounds the divergence of the trajectories of a switched stochastic control system and the switched nominal control system in a probabilistic fashion.We first design a feedforward controller by solving an optimization problem for the nominal trajectory of the deterministic control system with robustness against initial state variations and stochastic uncertainties. Then we generate a feedback control law from the data of the simulated trajectories. We implement our control method on both a four-bus system and a nine-bus system, and test the effectiveness of the method with a generation loss disturbance. We also test the advantage of the feedback controller over the feedforward controller when unexpected disturbance occurs.


title: Imaging Mechanism for Hyperspectral Scanning Probe Microscopy via Gaussian Process Modelling

abstract: We investigate the ability to reconstruct and derive spatial structure from sparsely sampled 3D piezoresponse force microcopy data, captured using the band-excitation (BE) technique, via Gaussian Process (GP) methods. Even for weakly informative priors, GP methods allow unambiguous determination of the characteristic length scales of the imaging process both in spatial and frequency domains. We further show that BE data set tends to be oversampled, with ~30% of the original data set sufficient for high-quality reconstruction, potentially enabling the faster BE imaging. Finally, we discuss how the GP can be used for automated experimentation in SPM, by combining GP regression with non-rectangular scans. The full code for GP regression applied to hyperspectral data is available at https://git.io/JePGr.


title: CMB B-mode non-Gaussianity: optimal bispectrum estimator and Fisher forecasts

abstract: Upcoming cosmic microwave background (CMB) data can be used to explore harmonic 3-point functions that involve the B-mode component of the CMB polarization signal. We focus on bispectra describing the non-Gaussian correlation of the B-mode field and the CMB temperature anisotropies (T) and/or E-mode polarization, i.e. <TTB>, <EEB>, and <TEB>. Such bispectra probe violations of the tensor consistency relation: the model-independent behavior of cosmological correlation functions that involve a large-wavelength tensor mode (gravitational wave). An observed violation of the tensor consistency relation would exclude a large number of inflation models. We describe a generalization of the Komatsu-Spergel-Wandelt (KSW) bispectrum estimator that allows statistical inference on this type of primordial non-Gaussianity with data of the CMB temperature and polarization anisotropies. The generalized estimator shares its statistical properties with the existing KSW estimator and retains the favorable numerical scaling with angular resolution. In this paper we derive the estimator and present a set of Fisher forecasts. We show how the forecasts scale with various experimental parameters such as lower and upper angular band-limit, relevant for e.g. the upcoming ground-based Simons Observatory experiment and proposed LiteBIRD satellite experiment. We comment on possible contaminants due to secondary cosmological and astrophysical sources.


title: Field choice problem in persistent homology

abstract: This paper tackles the problem of coefficient field choice in persistent homology. When we compute a persistence diagram, we need to select a coefficient field before computation. We should understand the dependency of the diagram on the coefficient field to facilitate computation and interpretation of the diagram. We clarify that the dependency is strongly related to the torsion of $\mathbb{Z}$ relative homology in the filtration. We show the sufficient and necessary conditions of the independence of coefficient field choice. An efficient algorithm is proposed to verify the independence. In a numerical experiment with the algorithm, a persistence diagram rarely changes even when the coefficient field changes if we consider a filtration in $\mathbb{R}^3$. The experiment suggests that, in practical terms, changes in the field coefficient will not change persistence diagrams when the data are in $\mathbb{R}^3$.


title: Distraction-Aware Feature Learning for Human Attribute Recognition via Coarse-to-Fine Attention Mechanism

abstract: Recently, Human Attribute Recognition (HAR) has become a hot topic due to its scientific challenges and application potentials, where localizing attributes is a crucial stage but not well handled. In this paper, we propose a novel deep learning approach to HAR, namely Distraction-aware HAR (Da-HAR). It enhances deep CNN feature learning by improving attribute localization through a coarse-to-fine attention mechanism. At the coarse step, a self-mask block is built to roughly discriminate and reduce distractions, while at the fine step, a masked attention branch is applied to further eliminate irrelevant regions. Thanks to this mechanism, feature learning is more accurate, especially when heavy occlusions and complex backgrounds exist. Extensive experiments are conducted on the WIDER-Attribute and RAP databases, and state-of-the-art results are achieved, demonstrating the effectiveness of the proposed approach.


title: Monte Carlo Radiation Transport Modelling of the Current-Biased Kinetic Inductance Detector

abstract: Radiation transport simulations were used to analyse neutron imaging with the current-biased kinetic inductance detector (CB-KID). The PHITS Monte Carlo code was applied for simulating neutron, $^{4}$He, $^{7}$Li, photon and electron transport, $^{10}$B(n,$\alpha$)$^{7}$Li reactions, and energy deposition by particles within CB-KID. Slight blurring in simulated CB-KID images originated $^{4}$He and $^{7}$Li ions spreading out in random directions from the $^{10}$B conversion layer in the detector prior to causing signals in the $X$ and $Y$ superconducting Nb nanowire meander lines. 478 keV prompt gamma rays emitted by $^{7}$Li nuclei from neutron-$^{10}$B reactions had negligible contribution to the simulated CB-KID images. Simulated neutron images of $^{10}$B dot arrays indicate that sub 10 $\mu$m resolution imaging should be feasible with the current CB-KID design. The effect of the geometrical structure of CB-KID on the intrinsic detection efficiency was calculated from the simulations. An analytical equation was then developed to approximate this contribution to the detection efficiency. Detection efficiencies calculated in this study are upper bounds for the reality as the effects of detector temperature, the bias current, signal processing and dead-time losses were not taken into account. The modelling strategies employed in this study could be used to evaluate modifications to the CB-KID design prior to actual fabrication and testing, conveying a time and cost saving.


title: Control of Permanent Magnet Motors with Actuation Bounds using Convex Optimization

abstract: This paper presents a nonlinear control algorithm for speed control of a permanent magnet motor. The idea relies on a feedback linearization technique which also ensures adherence to current and voltage bounds. These bounds arise from practical limitations of the power source. The feedback linearization law is computed using a convex optimization routine to minimize response time as well. The aid of convex optimization leads to computational efficiency. Moreover, the mathematical tractability of the approach also aids analysis of the system performance under model uncertainty and feedback measurement noise. Simulations and computations corroborate the proposed idea.


abstract: In many advanced network analysis applications, like social networks, e-commerce, and network security, hotspots are generally considered as a group of vertices that are tightly connected owing to the similar characteristics, such as common habits and location proximity. In this paper, we investigate the formation of hotspots from an alternative perspective that considers the routes along the network paths as the auxiliary information, and attempt to find the route hotspots in large labeled networks. A route hotspot is a cohesive subgraph that is covered by a set of routes, and these routes correspond to the same sequential pattern consisting of vertices' labels. To the best of our knowledge, the problem of Finding Route Hotspots in Large Labeled Networks has not been tackled in the literature. However, it is challenging as counting the number of hotspots in a network is #P-hard. Inspired by the observation that the sizes of hotspots decrease with the increasing lengths of patterns, we prove several anti-monotonicity properties of hotspots, and then develop a scalable algorithm called FastRH that can use these properties to effectively prune the patterns that cannot form any hotspots. In addition, to avoid the duplicate computation overhead, we judiciously design an effective index structure called RH-Index for storing the hotspot and pattern information collectively, which also enables incremental updating and efficient query processing. Our experimental results on real-world datasets clearly demonstrate the effectiveness and scalability of our proposed methods.


title: Symplectic non-squeezing for the KdV flow on the line

abstract: We show symplectic non-squeezing for the KdV equation on the line $\mathbb R$. This is achieved via finite-dimensional approximation. Our choice of finite-dimensional Hamiltonian system that effectively approximates the KdV flow is inspired by the recent breakthrough of Killip and Visan in the well-posedness theory of KdV in low regularity spaces, relying on its completely integrable structure. We also prove and exploit a weak well-posedness result for KdV in $H^{-1}(\mathbb R)$. Furthermore, the employment of our methods provides a new concise proof for the known result of symplectic non-squeezing for the same equation on the circle $\mathbb T$, first proved by Colliander, Keel, Staffilani, Takaoka, and Tao.


title: Semantic Interior Mapology: A Toolbox For Indoor Scene Description From Architectural Floor Plans

abstract: We introduce the Semantic Interior Mapology (SIM) toolbox for the conversion of a floor plan and its room contents (such as furnitures) to a vectorized form. The toolbox is composed of the Map Conversion toolkit and the Map Population toolkit. The Map Conversion toolkit allows one to quickly trace the layout of a floor plan, and to generate a GeoJSON file that can be rendered in 3D using web applications such as Mapbox. The Map Population toolkit takes the 3D scan of a room in the building (acquired from an RGB-D camera), and, through a semi-automatic process, populates individual objects of interest with a correct dimension and position in the GeoJSON representation of the building. SIM is easy to use and produces accurate results even in the case of complex building layouts.


title: Semantic Bottleneck Scene Generation

abstract: Coupling the high-fidelity generation capabilities of label-conditional image synthesis methods with the flexibility of unconditional generative models, we propose a semantic bottleneck GAN model for unconditional synthesis of complex scenes. We assume pixel-wise segmentation labels are available during training and use them to learn the scene structure. During inference, our model first synthesizes a realistic segmentation layout from scratch, then synthesizes a realistic scene conditioned on that layout. For the former, we use an unconditional progressive segmentation generation network that captures the distribution of realistic semantic scene layouts. For the latter, we use a conditional segmentation-to-image synthesis network that captures the distribution of photo-realistic images conditioned on the semantic layout. When trained end-to-end, the resulting model outperforms state-of-the-art generative models in unsupervised image synthesis on two challenging domains in terms of the Frechet Inception Distance and user-study evaluations. Moreover, we demonstrate the generated segmentation maps can be used as additional training data to strongly improve recent segmentation-to-image synthesis networks.


title: CAWA: An Attention-Network for Credit Attribution

abstract: Credit attribution is the task of associating individual parts in a document with their most appropriate class labels. It is an important task with applications to information retrieval and text summarization. When labeled training data is available, traditional approaches for sequence tagging can be used for credit attribution. However, generating such labeled datasets is expensive and time-consuming. In this paper, we present "Credit Attribution With Attention (CAWA)", a neural-network-based approach, that instead of using sentence-level labeled data, uses the set of class labels that are associated with an entire document as a source of distant-supervision. CAWA combines an attention mechanism with a multilabel classifier into an end-to-end learning framework to perform credit attribution. CAWA labels the individual sentences from the input document using the resultant attention-weights. CAWA improves upon the state-of-the-art credit attribution approach by not constraining a sentence to belong to just one class, but modeling each sentence as a distribution over all classes, leading to better modeling of semantically-similar classes. Experiments on the credit attribution task on a variety of datasets show that the sentence class labels generated by CAWA outperform the competing approaches. Additionally, on the multilabel text classification task, CAWA performs better than the competing credit attribution approaches.


title: Towards Universal Languages for Tractable Ontology Mediated Query Answering

abstract: An ontology language for ontology mediated query answering (OMQA-language) is universal for a family of OMQA-languages if it is the most expressive one among this family. In this paper, we focus on three families of tractable OMQA-languages, including first-order rewritable languages and languages whose data complexity of the query answering is in AC0 or PTIME. On the negative side, we prove that there is, in general, no universal language for each of these families of languages. On the positive side, we propose a novel property, the locality, to approximate the first-order rewritability, and show that there exists a language of disjunctive embedded dependencies that is universal for the family of OMQA-languages with locality. All of these results apply to OMQA with query languages such as conjunctive queries, unions of conjunctive queries and acyclic conjunctive queries.


title: Robust Estimation of Hypernasality in Dysarthria with Acoustic Model Likelihood Features

abstract: Hypernasality is a common characteristic symptom across many motor-speech disorders. For voiced sounds, hypernasality introduces an additional resonance in the lower frequencies and, for unvoiced sounds, there is reduced articulatory precision due to air escaping through the nasal cavity. However, the acoustic manifestation of these symptoms is highly variable, making hypernasality estimation very challenging, both for human specialists and automated systems. Previous work in this area relies on either engineered features based on statistical signal processing or machine learning models trained on clinical ratings. Engineered features often fail to capture the complex acoustic patterns associated with hypernasality, whereas metrics based on machine learning are prone to overfitting to the small disease-specific speech datasets on which they are trained. Here we propose a new set of acoustic features that capture these complementary dimensions. The features are based on two acoustic models trained on a large corpus of healthy speech. The first acoustic model aims to measure nasal resonance from voiced sounds, whereas the second acoustic model aims to measure articulatory imprecision from unvoiced sounds. To demonstrate that the features derived from these acoustic models are specific to hypernasal speech, we evaluate them across different dysarthria corpora. Our results show that the features generalize even when training on hypernasal speech from one disease and evaluating on hypernasal speech from another disease (e.g. training on Parkinson's disease, evaluation on Huntington's disease), and when training on neurologically disordered speech but evaluating on cleft palate speech.


title: Behavior Regularized Offline Reinforcement Learning

abstract: In reinforcement learning (RL) research, it is common to assume access to direct online interactions with the environment. However in many real-world applications, access to the environment is limited to a fixed offline dataset of logged experience. In such settings, standard RL algorithms have been shown to diverge or otherwise yield poor performance. Accordingly, recent work has suggested a number of remedies to these issues. In this work, we introduce a general framework, behavior regularized actor critic (BRAC), to empirically evaluate recently proposed methods as well as a number of simple baselines across a variety of offline continuous control tasks. Surprisingly, we find that many of the technical complexities introduced in recent methods are unnecessary to achieve strong performance. Additional ablations provide insights into which design choices matter most in the offline RL setting.


title: Neural network for pricing and universal static hedging of contingent claims

abstract: We present here a regress later based Monte Carlo approach that uses neural networks for pricing high-dimensional contingent claims. The choice of specific architecture of the neural networks used in the proposed algorithm provides for interpretability of the model, a feature that is often desirable in the financial context. Specifically, the interpretation leads us to demonstrate that any contingent claim -- possibly high dimensional and path-dependent -- under the Markovian and the no-arbitrage assumptions, can be semi-statically hedged using a portfolio of short maturity options. We show how the method can be used to obtain an upper and lower bound to the true price, where the lower bound is obtained by following a sub-optimal policy, while the upper bound by exploiting the dual formulation. Unlike other duality based upper bounds where one typically has to resort to nested simulation for constructing super-martingales, the martingales in the current approach come at no extra cost, without the need for any sub-simulations. We demonstrate through numerical examples the simplicity and efficiency of the method for both pricing and semi-static hedging of path-dependent options


title: Gradient Perturbation is Underrated for Differentially Private Convex Optimization

abstract: Gradient perturbation, widely used for differentially private optimization, injects noise at every iterative update to guarantee differential privacy. Previous work first determines the noise level that can satisfy the privacy requirement and then analyzes the utility of noisy gradient updates as in the non-private case. In contrast, we explore how privacy noise affects optimization property. We show that for differentially private convex optimization, the utility guarantee of differentially private (stochastic) gradient descent is determined by an \emph{expected curvature} rather than the minimum curvature. The \emph{expected curvature}, which represents the average curvature over the optimization path, is usually much larger than the minimum curvature. By using the \emph{expected curvature}, we show that gradient perturbation can achieve a significantly improved utility guarantee that can theoretically justify the advantage of gradient perturbation over other perturbation methods. Finally, our extensive experiments suggest that gradient perturbation with the advanced composition method indeed outperforms other perturbation approaches by a large margin, matching our theoretical findings.


title: Multiwavelength Polarimetry of the Filamentary Cloud IC5146: II. Magnetic Field Structures

abstract: The IC5146 cloud is a nearby star-forming region in Cygnus, consisting of molecular gas filaments in a variety of evolutionary stages. We used optical and near-infrared polarization data toward the IC5146 cloud, reported in the first paper of this series, to reveal the magnetic fields in this cloud. Using the newly released $Gaia$ data, we found that the IC5146 cloud may contain two separate clouds: a first cloud, including the densest main filament at a distance of $\sim$600 pc, and a second cloud, associated with the Cocoon Nebula at a distance of $\sim$800 pc. The spatially averaged H-band polarization map revealed a well-ordered magnetic field morphology, with the polarization segments perpendicular to the main filament but parallel to the nearby sub-filaments, consistent with models assuming that the magnetic field is regulating cloud evolution. We estimated the magnetic field strength using the Davis-Chandrasekhar-Fermi method, and found that the magnetic field strength scales with volume density with a power-law index of $\sim0.5$ in the density range from $N_{H_2}\sim$ 10 to 3000 cm$^{-3}$, which indicates an anisotropic cloud contraction with a preferred direction along the magnetic field. In addition, the mass-to-flux ratio of the cloud gradually changes from subcritical to supercritical from the cloud envelope to the deep regions. These features are consistent with strong magnetic field star-formation models and suggest that the magnetic field is important in regulating the evolution of the IC5146 cloud.


title: ATCSpeech: a multilingual pilot-controller speech corpus from real Air Traffic Control environment

abstract: Automatic Speech Recognition (ASR) is greatly developed in recent years, which expedites many applications on other fields. For the ASR research, speech corpus is always an essential foundation, especially for the vertical industry, such as Air Traffic Control (ATC). There are some speech corpora for common applications, public or paid. However, for the ATC, it is difficult to collect raw speeches from real systems due to safety issues. More importantly, for a supervised learning task like ASR, annotating the transcription is a more laborious work, which hugely restricts the prospect of ASR application. In this paper, a multilingual speech corpus (ATCSpeech) from real ATC systems, including accented Mandarin Chinese and English, is built and released to encourage the non-commercial ASR research in ATC domain. The corpus is detailly introduced from the perspective of data amount, speaker gender and role, speech quality and other attributions. In addition, the performance of our baseline ASR models is also reported. A community edition for our speech database can be applied and used under a special contrast. To our best knowledge, this is the first work that aims at building a real and multilingual ASR corpus for the air traffic related research.


title: Newton-type Multilevel Optimization Method

abstract: Inspired by multigrid methods for linear systems of equations, multilevel optimization methods have been proposed to solve structured optimization problems. Multilevel methods make more assumptions regarding the structure of the optimization model, and as a result, they outperform single-level methods, especially for large-scale models. The impressive performance of multilevel optimization methods is an empirical observation, and no theoretical explanation has so far been proposed. In order to address this issue, we study the convergence properties of a multilevel method that is motivated by second-order methods. We take the first step toward establishing how the structure of an optimization problem is related to the convergence rate of multilevel algorithms.


title: Nematicity with a twist: rotational symmetry breaking in a moir\'e superlattice

abstract: Motivated by recent reports of nematic order in twisted bilayer graphene (TBG), we investigate the impact of the triangular moir\'e superlattice degrees of freedom on nematicity. In TBG, the nematic order parameter is not Ising-like, as it is the case in tetragonal crystals, but has a 3-state Potts character related to the threefold rotational symmetry ($C_{3z}$) of the moir\'e superlattice. We find that even in the presence of static strain that explicitly breaks the $C_{3z}$ symmetry, the system can still undergo a nematic-flop phase transition that spontaneously breaks in-plane twofold rotations. Moreover, elastic fluctuations, manifested as acoustic phonons, mediate a nemato-orbital coupling that ties the orientation of the nematic director to certain soft directions in momentum space, rendering the Potts-nematic transition mean-field and first-order. In contrast to the case of rigid crystals, the Fermi-surface hot-spots associated with these soft directions are maximally coupled to the low-energy nematic fluctuations in the case of the moir\'e superlattice.


title: Pseudo-deterministic Streaming

abstract: A pseudo-deterministic algorithm is a (randomized) algorithm which, when run multiple times on the same input, with high probability outputs the same result on all executions. Classic streaming algorithms, such as those for finding heavy hitters, approximate counting, $\ell_2$ approximation, finding a nonzero entry in a vector (for turnstile algorithms) are not pseudo-deterministic. For example, in the instance of finding a nonzero entry in a vector, for any known low-space algorithm $A$, there exists a stream $x$ so that running $A$ twice on $x$ (using different randomness) would with high probability result in two different entries as the output. In this work, we study whether it is inherent that these algorithms output different values on different executions. That is, we ask whether these problems have low-memory pseudo-deterministic algorithms. For instance, we show that there is no low-memory pseudo-deterministic algorithm for finding a nonzero entry in a vector (given in a turnstile fashion), and also that there is no low-dimensional pseudo-deterministic sketching algorithm for $\ell_2$ norm estimation. We also exhibit problems which do have low memory pseudo-deterministic algorithms but no low memory deterministic algorithm, such as outputting a nonzero row of a matrix, or outputting a basis for the row-span of a matrix. We also investigate multi-pseudo-deterministic algorithms: algorithms which with high probability output one of a few options. We show the first lower bounds for such algorithms. This implies that there are streaming problems such that every low space algorithm for the problem must have inputs where there are many valid outputs, all with a significant probability of being outputted.


title: The effect of radiation corrections to the mass of an electron and positron on the polarization operator of a photon in a magnetic field

abstract: The polarization operator of a photon in a constant and uniform magnetic field is studied taking into account the radiation width and shift of the Landau levels in both weak and strong fields compared with the critical field $H_0=4,41\cdot10^{13}$ G . A general formula is obtained for the polarization operator of a photon in which radiation effects are taken into account. Now diverging previously threshold terms have a finite value. The conditions are formulated under which the energy levels completely overlap, and thereby the most appropriate application of the semiclassical operator method to the problem under study becomes.


title: Symmetric differentials and the dimension of Hitchin components for orbi-curves

abstract: This note is based on a talk given at the 2019 ISAAC Congress in Aveiro, Portugal. We give an expository account of joint work with Daniele Alessandrini and Gye-Seon Lee on Hitchin components for orbifold groups (arXiv:1811.05366), recasting part of it in the language of analytic orbi-curves. This reduces the computation of the dimension of the Hitchin component for orbifold groups to an application of the orbifold Riemann-Roch theorem.


title: Mixed-spin system with supersolid phases: Magnetocaloric effect and thermal properties

abstract: Recently, it has been shown that two dimensional frustrated mixed-spin systems with anisotropic exchange interactions display supersolid phases in their ground state phase diagrams even in the absence of long-range interactions. In this paper, using cluster mean field theory, we investigate the effects of thermal fluctuations on the ground state phases of this kind of systems and show that various thermal solids and thermal insulators emerge around the ground state solid and Mott insulating phases. We also study the thermodynamic properties and magnetocaloric effect of these systems and demonstrate that at low temperatures, a large cooling rate is seen in the vicinity of the solid-supersolid, solid-superfluid and Mott insulator-superfluid critical points, with the large accumulation of the entropy and the minimums of the isentropes. Our results show the sign change of the magnetocaloric parameter inside the solids and the Mott insulator, which is a characteristic of ordered phases.


title: Substrate dopant induced electronic inhomogeneity in epitaxial bilayer graphene

abstract: Two-dimensional (2D) materials have become a new territory for exploring novel properties and functionalities because of their superior tunability. The unprecedented tunability of 2D materials is also accompanied by many and equally great challenges, as they are susceptible to defects and disorders. The presence of defects and disorders induces the inhomogeneity of electronic states, often making it difficult to directly probe the intrinsic properties of materials. Therefore, many efforts have been devoted to improve the electronic homogeneity, for example, by reducing the density of defects and disorders in the materials and at the interface. However, little attention is paid to the disorders embedded in underlying substrates. Here we investigate how individual dopants in substrate interact with 2D materials and give rise to the electron-hole puddles by low temperature scanning tunneling microscopy (STM) and spectroscopy (STS). Specifically, we take the epitaxial bilayer graphene grown on nitrogen doped silicon carbide (SiC) substrates as a model system, which has played the essential roles in many applications and fundamental studies. The nitrogen dopants inside SiC substrate were imaged over the epitaxial graphene by STM for the first time. The charged nitrogen dopants from the substrate induce the electron-lack puddles in graphene with a diameter of ~2 nm, via Coulomb interaction. The Fermi level with respect to the Dirac point is modulated by the puddles with an amplitude of ~40 meV, causing the electronic inhomogeneity of epitaxial graphene. Our findings on this prototype material are expected to facilitate the quality improvement of graphene and other 2D materials in general.


title: A two-step system for sound event localization and detection

abstract: Sound event detection and sound event localization requires different features from audio input signals. While sound event detection mainly relies on time-frequency patterns to distinguish different event classes, sound event localization uses magnitude or phase differences between microphones to estimate source directions. Therefore, we propose a two-step system to do sound event localization and detection. In the first step, we detect the sound events and estimate the directions-of-arrival separately. In the second step, we combine the results of the event detector and direction-of-arrival estimator together. The obtained results show a significant improvement over the baseline solution for sound event localization and detection in DCASE 2019 task 3 challenge. Using the evaluation dataset, the proposed system achieved an F1 score of 93.4% for sound event detection and an error of 5.4 degrees for direction-of-arrival estimation, while the winning solution achieved an F1 score of 94.7% and an angle error of 3.7 degrees respectively.


title: Representation Learning: A Statistical Perspective

abstract: Learning representations of data is an important problem in statistics and machine learning. While the origin of learning representations can be traced back to factor analysis and multidimensional scaling in statistics, it has become a central theme in deep learning with important applications in computer vision and computational neuroscience. In this article, we review recent advances in learning representations from a statistical perspective. In particular, we review the following two themes: (a) unsupervised learning of vector representations and (b) learning of both vector and matrix representations.


title: Optimal Design of Energy-Efficient Cell-Free Massive MIMO: Joint Power Allocation and Load Balancing

abstract: A large-scale distributed antenna system that serves the users by coherent joint transmission is called Cell-free Massive MIMO (multiple input multiple output). For a given user set, only a subset of the access points (APs) is likely needed to satisfy the users' performance demands. To find a flexible and energy-efficient implementation, we minimize the total power consumption at the APs in the downlink, considering both the hardware and transmit powers, where APs can be turned off. Even though this is a non-convex optimization problem, a globally optimal solution is obtained by solving a mixed-integer second-order cone program. We also propose a low-complexity algorithm that exploits group-sparsity in the problem formulation. Numerical results manifest that our optimization framework can greatly reduce the power consumption compared to keeping all APs turned on and only minimizing the transmit powers.


title: Mandala: A Smart Contract Programming Language

abstract: Smart contracts on a blockchain behave precisely as specified by their code. A vulnerability in this code can lead to unexpected behaviour, which is hard to fix because a blockchain does not allow to change smart contract code after its deployment. Such vulnerabilities have led to several incidents. In the aftermath of such an event, a hard-fork between Ethereum and Ethereum classic was the result. This thesis proposes to develop a new smart contract programming language with the primary focus on safety, auditability, and the intention to prevent as many of the known categories of vulnerabilities by design as possible. The programming language's code is validated during deployment and afterwards isolated from other smart contracts running on the same blockchain to enforce compile-time guarantees during runtime. The designed programming language does evaluate new concepts and paradigms rarely used in non-smart contract environments for their potential benefit in a smart contract environment.


title: Privacy preserving Neural Network Inference on Encrypted Data with GPUs

abstract: Machine Learning as a Service (MLaaS) has become a growing trend in recent years and several such services are currently offered. MLaaS is essentially a set of services that provides machine learning tools and capabilities as part of cloud computing services. In these settings, the cloud has pre-trained models that are deployed and large computing capacity whereas the clients can use these models to make predictions without having to worry about maintaining the models and the service. However, the main concern with MLaaS is the privacy of the client's data. Although there have been several proposed approaches in the literature to run machine learning models on encrypted data, the performance is still far from being satisfactory for practical use. In this paper, we aim to accelerate the performance of running machine learning on encrypted data using combination of Fully Homomorphic Encryption (FHE), Convolutional Neural Networks (CNNs) and Graphics Processing Units (GPUs). We use a number of optimization techniques, and efficient GPU-based implementation to achieve high performance. We evaluate a CNN whose architecture is similar to AlexNet to classify homomorphically encrypted samples from the Cars Overhead With Context (COWC) dataset. To the best of our knowledge, it is the first time such a complex network and large dataset is evaluated on encrypted data. Our approach achieved reasonable classification accuracy of 95% for the COWC dataset. In terms of performance, our results show that we could achieve several thousands times speed up when we implement GPU-accelerated FHE operations on encrypted floating point numbers.


title: Text2FaceGAN: Face Generation from Fine Grained Textual Descriptions

abstract: Powerful generative adversarial networks (GAN) have been developed to automatically synthesize realistic images from text. However, most existing tasks are limited to generating simple images such as flowers from captions. In this work, we extend this problem to the less addressed domain of face generation from fine-grained textual descriptions of face, e.g., "A person has curly hair, oval face, and mustache". We are motivated by the potential of automated face generation to impact and assist critical tasks such as criminal face reconstruction. Since current datasets for the task are either very small or do not contain captions, we generate captions for images in the CelebA dataset by creating an algorithm to automatically convert a list of attributes to a set of captions. We then model the highly multi-modal problem of text to face generation as learning the conditional distribution of faces (conditioned on text) in same latent space. We utilize the current state-of-the-art GAN (DC-GAN with GAN-CLS loss) for learning conditional multi-modality. The presence of more fine-grained details and variable length of the captions makes the problem easier for a user but more difficult to handle compared to the other text-to-image tasks. We flipped the labels for real and fake images and added noise in discriminator. Generated images for diverse textual descriptions show promising results. In the end, we show how the widely used inceptions score is not a good metric to evaluate the performance of generative models used for synthesizing faces from text.


title: Content-based image retrieval speedup

abstract: Content-based image retrieval (CBIR) is a task of retrieving images from their contents. Since retrieval process is a time-consuming task in large image databases, acceleration methods can be very useful. This paper presents a novel method to speed up CBIR systems. In the proposed method, first Zernike moments are extracted from query image and an interval is calculated for that query. Images in database which are out of the interval are ignored in retrieval process. Therefore, a database reduction occurs before retrieval which leads to speed up. It is shown that in reduced database, relevant images to query image are preserved and irrelevant images are throwed away. Therefore, the proposed method speed up retrieval process and preserve CBIR accuracy, simultaneously.


title: Using Physics-Informed Super-Resolution Generative Adversarial Networks for Subgrid Modeling in Turbulent Reactive Flows

abstract: Turbulence is still one of the main challenges for accurately predicting reactive flows. Therefore, the development of new turbulence closures which can be applied to combustion problems is essential. Data-driven modeling has become very popular in many fields over the last years as large, often extensively labeled, datasets became available and training of large neural networks became possible on GPUs speeding up the learning process tremendously. However, the successful application of deep neural networks in fluid dynamics, for example for subgrid modeling in the context of large-eddy simulations (LESs), is still challenging. Reasons for this are the large amount of degrees of freedom in realistic flows, the high requirements with respect to accuracy and error robustness, as well as open questions, such as the generalization capability of trained neural networks in such high-dimensional, physics-constrained scenarios. This work presents a novel subgrid modeling approach based on a generative adversarial network (GAN), which is trained with unsupervised deep learning (DL) using adversarial and physics-informed losses. A two-step training method is used to improve the generalization capability, especially extrapolation, of the network. The novel approach gives good results in a priori as well as a posteriori tests with decaying turbulence including turbulent mixing. The applicability of the network in complex combustion scenarios is furthermore discussed by employing it to a reactive LES of the Spray A case defined by the Engine Combustion Network (ECN).

categories: cs.LG cs.GR physics.comp-ph physics.flu-dyn stat.ML


title: On the Complexity of Minimum-Cost Networked Estimation of Self-Damped Dynamical Systems

abstract: In this paper, we consider the optimal design of networked estimators to minimize the communication/measurement cost under the networked observability constraint. This problem is known as the minimum-cost networked estimation problem, which is generally claimed to be NP-hard. The main contribution of this work is to provide a polynomial-order solution for this problem under the constraint that the underlying dynamical system is self-damped. Using structural analysis, we subdivide the main problem into two NP-hard subproblems known as (i) optimal sensor selection, and (ii) minimum-cost communication network. For self-damped dynamical systems, we provide a polynomial-order solution for subproblem (i). Further, we show that the subproblem (ii) is of polynomial-order complexity if the links in the communication network are bidirectional. We provide an illustrative example to explain the methodologies.


title: Real-time dynamics of string breaking in quantum spin chains

abstract: String breaking is a central dynamical process in theories featuring confinement, where a string connecting two charges decays at the expense of the creation of new particle-antiparticle pairs. Here, we show that this process can also be observed in quantum Ising chains where domain walls get confined either by a symmetry-breaking field or by long-range interactions. We find that string breaking occurs, in general, as a two-stage process: First, the initial charges remain essentially static and stable. The connecting string, however, can become a dynamical object. We develop an effective description of this motion, which we find is strongly constrained. In the second stage, which can be severely delayed due to these dynamical constraints, the string finally breaks. We observe that the associated time scale can depend crucially on the initial separation between domain walls and can grow by orders of magnitude by changing the distance by just a few lattice sites. We discuss how our results generalize to one-dimensional confining gauge theories and how they can be made accessible in quantum simulator experiments such as Rydberg atoms or trapped ions.

categories: cond-mat.stat-mech cond-mat.quant-gas hep-th quant-ph


title: The decay $\tau \to K^{*-}(892) \eta \nu_{\tau}$ in the NJL model

abstract: The decay width $\tau \to K^{*-}(892) \eta \nu_{\tau}$ was calculated in the Nambu--Jona-Lasinio model. Four channels were taken into account: the contact channel (the final states are directly producted from lepton current without any intermediate meson states), the axial-vector channel with two intermediate physical states $K_{1}(1270)$ and $K_{1}(1400)$, the vector channel with intermediate $K^{*}(892)$ meson and the pseudoscalar channel with intermediate $K$ meson. It is shown that the first two channels give the dominant contribution to the decay width. Of the remaining two channels, the pseudoscalar channel plays a more prominent role. The final result is in satisfactory agreement with experimental data. Prediction for the differential decay width is presented.


title: Multi-Task Driven Feature Models for Thermal Infrared Tracking

abstract: Existing deep Thermal InfraRed (TIR) trackers usually use the feature models of RGB trackers for representation. However, these feature models learned on RGB images are neither effective in representing TIR objects nor taking fine-grained TIR information into consideration. To this end, we develop a multi-task framework to learn the TIR-specific discriminative features and fine-grained correlation features for TIR tracking. Specifically, we first use an auxiliary classification network to guide the generation of TIR-specific discriminative features for distinguishing the TIR objects belonging to different classes. Second, we design a fine-grained aware module to capture more subtle information for distinguishing the TIR objects belonging to the same class. These two kinds of features complement each other and recognize TIR objects in the levels of inter-class and intra-class respectively. These two feature models are learned using a multi-task matching framework and are jointly optimized on the TIR tracking task. In addition, we develop a large-scale TIR training dataset to train the network for adapting the model to the TIR domain. Extensive experimental results on three benchmarks show that the proposed algorithm achieves a relative gain of 10% over the baseline and performs favorably against the state-of-the-art methods. Codes and the proposed TIR dataset are available at {https://github.com/QiaoLiuHit/MMNet}.


title: Exciton-Polariton Topological Insulator with an Array of Magnetic Dots

abstract: Recently there have been several proposals on exciton-polariton topological insulators, most requiring strong external magnetic fields induced by bulky superconducting coils. We propose an alternate design for a polariton topological insulator, where excitons are in a proximity of an additional layer of a ferromagnetic material with a predefined magnetic moment located between the pillars of the cavity. Our design supports a variety of topological phases and transitions between Chern numbers $\pm 2$ and $\pm 1$ by varying either the magnetic moment of the ferromagnetic material or the spin-orbit coupling between different spin projections, thus enabling compact polariton devices harnessing switchable topological edge modes.


title: Landau Raman Regulation Observed from Geometric Graphene Structures Including Single-Wall Carbon Nanotubes

abstract: Here, we report Landau regulation in Raman modes for geometric graphene structures including single-wall carbon nanotubes (SWNTs). First-principles calculations show that radial-tangential Raman modes (RTMs) (comprising radial and tangential Eigenvectors) appear in order, following radial breading mode (RBM) (~150 cm-1). RTMs reveal two degenerated or non-degenerated frequencies per node and extend upto G (~1590 cm-1). In Raman measurements for SWNTs, we demonstrate the existence of RTMs at ~180-1440 cm-1, which have been partially interpreted as RBM band for ~180-300 cm-1 and intermediate frequency mode for 600-1300 cm-1. We reinterpret the RBM band as a coalescent signature of RBM (~150-170 cm-1) and 1st node RTM (~170-190 cm-1) for geometric graphene structures of ~2.0-2.2 nm in diameter. The sequential appearance of RBM and RTM and the revelation of the double degeneracy are due to Landau regulation working on spatial variation of the radial and tangential Eigenvectors. Our findings provide a further way of understanding the nature of low dimensional materials utilizing Raman spectroscopy.


title: Cracking In-Memory Database Index A Case Study for Adaptive Radix Tree Index

abstract: Indexes provide a method to access data in databases quickly. It can improve the response speed of subsequent queries by building a complete index in advance. However, it also leads to a huge overhead of the continuous updating during creating the index. An in-memory database usually has a higher query processing performance than disk databases and is more suitable for real-time query processing. Therefore, there is an urgent need to reduce the index creation and update cost for in-memory databases. Database cracking technology is currently recognized as an effective method to reduce the index initialization time. However, conventional cracking algorithms are focused on simple column data structure rather than those complex index structure for in-memory databases. In order to show the feasibility of in-memory database index cracking and promote to future more extensive research, this paper conducted a case study on the Adaptive Radix Tree (ART), a popular tree index structure of in-memory databases. On the basis of carefully examining the ART index construction overhead, an algorithm using auxiliary data structures to crack the ART index is proposed.


title: Minimal Driver Nodes for Structural Controllability of Large-Scale Dynamical Systems: Node Classification

abstract: This paper considers the problem of minimal control inputs to affect the system states such that the resulting system is structurally controllable. This problem and the dual problem of minimal observability are claimed to have no polynomial-order exact solution and, therefore, are NP-hard. Here, adopting a graph-theoretic approach, this problem is solved for general nonlinear (and also structure-invariant) systems and a P-order solution is proposed. In this direction, the dynamical system is modeled as a directed graph, called \textit{system digraph}, and two types of graph components are introduced which are tightly related with structural controllability. Two types of nodes which are required to be affected (or driven) by an input, called \textit{driver nodes}, are defined, and minimal number of these driver nodes are obtained. Polynomial-order complexity of the given algorithms to solve the problem ensures applicability of the solution for analysis of large-scale dynamical systems. {The structural results in this paper are significant as compared to the existing literature which offer approximate and computationally less-efficient, e.g. Gramian-based, solutions for the problem, while this paper provides exact solution with lower computational complexity and applicable for controllability analysis of nonlinear systems.


title: Data-compatibility of algorithms

abstract: The data-compatibility approach to constrained optimization, proposed here, strives to a point that is "close enough" to the solution set and whose target function value is "close enough" to the constrained minimum value. These notions can replace analysis of asymptotic convergence to a solution point of infinite sequences generated by specific algorithms. We consider a problem of minimizing a convex function over the intersection of the fixed point sets of nonexpansive mappings and demonstrate the data-compatibility of the Hybrid Subgradient Method (HSM). A string-averaging HSM is obtained as a by-product and relevance to the minimization over disjoint hard and soft constraints sets is discussed.


title: Efficient Attention Mechanism for Visual Dialog that can Handle All the Interactions between Multiple Inputs

abstract: It has been a primary concern in recent studies of vision and language tasks to design an effective attention mechanism dealing with interactions between the two modalities. The Transformer has recently been extended and applied to several bi-modal tasks, yielding promising results. For visual dialog, it becomes necessary to consider interactions between three or more inputs, i.e., an image, a question, and a dialog history, or even its individual dialog components. In this paper, we present a neural architecture named Light-weight Transformer for Many Inputs (LTMI) that can efficiently deal with all the interactions between multiple such inputs in visual dialog. It has a block structure similar to the Transformer and employs the same design of attention computation, whereas it has only a small number of parameters, yet has sufficient representational power for the purpose. Assuming a standard setting of visual dialog, a layer built upon the proposed attention block has less than one-tenth of parameters as compared with its counterpart, a natural Transformer extension. The experimental results on the VisDial datasets validate the effectiveness of the proposed approach, showing improvements of the best NDCG score on the VisDial v1.0 dataset from 57.59 to 60.92 with a single model, from 64.47 to 66.53 with ensemble models, and even to 74.88 with additional finetuning. Our implementation code is available at https://github.com/davidnvq/visdial.


title: SU(3) symmetry in theory of a weakly interacting gas of spin-1 atoms with Bose-Einstein condensate

abstract: We study a many-body system of interacting spin-1 particles in the context of homogeneous gases of ultracold atoms. In general, its description requires eight parameters among which there are three components of magnetization and five parameters associated with quadrupole degrees of freedom. Based on the symmetry considerations, we construct a many-body interaction Hamiltonian that includes eight generators of the SU(3) group related to the above description parameters. The SU(3) symmetric Hamiltonian is applied to study the ferromagnetic and quadrupolar phases of a homogeneous weakly interacting gas of spin-1 atoms with Bose-Einstein condensate. It is shown how the quadrupole degrees of freedom entering the Hamiltonian modify the ground state and single-particle excitation spectra in comparison with those obtained from the Hamiltonian bilinear in spin operators and not including quadrupole degrees of freedom. We discuss the issue of taking into account the local character of interaction to obtain the correct spectra of single-particle excitations.