title: Single-photon source with ultranarrow linewidth manipulated by coherent fields

abstract: Recent works [PhysRevLett.125.170402 (2020) and PhysRevLett.125.043603 (2020)] verify that the perfect single-photon character is a global property of resonance fluorescence including all the spectral components, and then the absence of some components can spoil the single-photon character, which considerably limits the application of filtering scheme to obtain single-photon source (SPS) with subnatural linewidth. Here, we note that the linewidth of fluorescent photon is not always limited by the intrinsic linewidth of the emitter, and provide a scheme where the linewidth of the fluorescent single photon can be much smaller than the natural linewidth of emitter by manipulating external coherent fields. By simulating the response of the filter or detection setup with a bandwidth approaching and even much smaller than the natural linewidth of emitter, the realization of ultranarrow SPS can be confirmed. Besides, we demonstrate that this scheme of ultranarrow SPS can be implemented based on various real physical platforms.


title: Forest Fire Clustering for Single-cell Sequencing with Iterative Label Propagation and Parallelized Monte Carlo Simulation

abstract: In the era of single-cell sequencing, there is a growing need to extract insights from data with clustering methods. Here, we introduce Forest Fire Clustering, an efficient and interpretable method for cell-type discovery from single-cell data. Forest Fire Clustering makes minimal prior assumptions and, different from current approaches, calculates a non-parametric posterior probability that each cell is assigned a cell-type label. These posterior distributions allow for the evaluation of a label confidence for each cell and enable the computation of "label entropies," highlighting transitions along developmental trajectories. Furthermore, we show that Forest Fire Clustering can make robust, inductive inferences in an online-learning context and can readily scale to millions of cells. Finally, we demonstrate that our method outperforms state-of-the-art clustering approaches on diverse benchmarks of simulated and experimental data. Overall, Forest Fire Clustering is a useful tool for rare cell type discovery in large-scale single-cell analysis.


title: TIFR Zero-Pressure balloon program crosses a milestone

abstract: High altitude scientific balloons offer unique opportunities to carry scientific payloads to stratospheric altitudes at a cost several orders of magnitude lower than corresponding satellite missions. Balloon-borne payloads are easy to implement allowing quick experiment turn-around times and inexpensive reflights can be conducted as payload is most of the times recovered. In addition, in-situ and high resolution spatial and temporal measurements of the earth's atmosphere can be made that might not be feasible with satellites. It is also used as a testbed to prove technologies for future satellite missions. Scientific ballooning was initiated at the Tata Institute of Fundamental Research (TIFR) in the year 1945 when scientific instruments were flown to stratospheric altitudes using a cluster of weather balloons for cosmic ray research. The need to have balloons float at constant stratospheric altitudes for astronomy studies led to the initiation of work on design and fabrication of Zero-Pressure polyethylene (ZP) balloons at TIFR in 1956. Since then several ZP balloon flights were conducted for studies in astronomy, atmospheric science, astrobiology, balloon technology and space technology development, leading to several important scientific results. In the year 2018, TIFR balloon program crossed an important milestone of conducting more than 500 ZP balloon flights. This paper presents recent advancements made in some areas of scientific ballooning and the details of balloon experiments conducted in the past two decades.


title: Detection of fake news on CoViD-19 on Web Search Engines

abstract: In early January 2020, after China reported the first cases of the new coronavirus (SARS-CoV-2) in the city of Wuhan, unreliable and not fully accurate information has started spreading faster than the virus itself. Alongside this pandemic, people have experienced a parallel infodemic, i.e., an overabundance of information, some of which misleading or even harmful, that has widely spread around the globe. Although Social Media are increasingly being used as information source, Web Search Engines, like Google or Yahoo!, still represent a powerful and trustworthy resource for finding information on the Web. This is due to their capability to capture the largest amount of information, helping users quickly identify the most relevant, useful, although not always the most reliable, results for their search queries. This study aims to detect potential misleading and fake contents by capturing and analysing textual information, which flow through Search Engines. By using a real-world dataset associated with recent CoViD-19 pandemic, we first apply re-sampling techniques for class imbalance, then we use existing Machine Learning algorithms for classification of not reliable news. By extracting lexical and host-based features of associated Uniform Resource Locators (URLs) for news articles, we show that the proposed methods, so common in phishing and malicious URLs detection, can improve the efficiency and performance of classifiers. Based on these findings, we suggest that the use of both textual and URLs features can improve the effectiveness of fake news detection methods.


title: Block Length Choice for the Bootstrap of Dependent Panel Data -- a Comment on Choi and Shin (2020)

abstract: Choi and Shin (2020) have constructed a bootstrap-based test for change-points in panels with temporal and and/or cross-sectional dependence. They have compared their test to several other proposed tests. We demonstrate that by an appropriate, data-adaptive choice of the block length, the change-point test by Sharipov, Tewes, Wendler (2016) can at least cope with mild temporal dependence, the size distortion of this test is not as severe as claimed by Choi and Shin (2020).


title: Tackling Racial Bias in Automated Online Hate Detection: Towards Fair and Accurate Classification of Hateful Online Users Using Geometric Deep Learning

abstract: Online hate is a growing concern on many social media platforms and other sites. To combat it, technology companies are increasingly identifying and sanctioning `hateful users' rather than simply moderating hateful content. Yet, most research in online hate detection to date has focused on hateful content. This paper examines how fairer and more accurate hateful user detection systems can be developed by incorporating social network information through geometric deep learning. Geometric deep learning dynamically learns information-rich network representations and can generalise to unseen nodes. This is essential for moving beyond manually engineered network features, which lack scalability and produce information-sparse network representations. This paper compares the accuracy of geometric deep learning with other techniques which either exclude network information or incorporate it through manual feature engineering (e.g., node2vec). It also evaluates the fairness of these techniques using the `predictive equality' criteria, comparing the false positive rates on a subset of 136 African-American users with 4836 other users. Geometric deep learning produces the most accurate and fairest classifier, with an AUC score of 90.8\% on the entire dataset and a false positive rate of zero among the African-American subset for the best performing model. This highlights the benefits of more effectively incorporating social network features in automated hateful user detection. Such an approach is also easily operationalized for real-world content moderation as it has an efficient and scalable design.


title: Data Cleansing for Deep Neural Networks with Storage-efficient Approximation of Influence Functions

abstract: Identifying the influence of training data for data cleansing can improve the accuracy of deep learning. An approach with stochastic gradient descent (SGD) called SGD-influence to calculate the influence scores was proposed, but, the calculation costs are expensive. It is necessary to temporally store the parameters of the model during training phase for inference phase to calculate influence sores. In close connection with the previous method, we propose a method to reduce cache files to store the parameters in training phase for calculating inference score. We only adopt the final parameters in last epoch for influence functions calculation. In our experiments on classification, the cache size of training using MNIST dataset with our approach is 1.236 MB. On the other hand, the previous method used cache size of 1.932 GB in last epoch. It means that cache size has been reduced to 1/1,563. We also observed the accuracy improvement by data cleansing with removal of negatively influential data using our approach as well as the previous method. Moreover, our simple and general proposed method to calculate influence scores is available on our auto ML tool without programing, Neural Network Console. The source code is also available.


title: There is Plenty of Room for THz Tunneling Electron Devices Beyond the Transit Time Limit

abstract: The traditional transmission coefficient present in the original Landauer formulation, which is valid for quasi-static scenarios with working frequencies below the inverse of the electron transit time, is substituted by a novel time-dependent displacement current coefficient valid for frequencies above this limit. Our model captures in a simple way the displacement current component of the total current, which at frequencies larger than the inverse of the electron transit time can be more relevant than the particle component. The proposed model is applied to compute the response of a resonant tunneling diode from 10$\,$GHz up to 5$\,$THz. We show that tunneling electron devices are intrinsically nonlinear at such high frequencies, even under small-signal conditions, due to memory effects related to the displacement current. We show that these intrinsic nonlinearities (anharmonicities) represent an advantage, rather than a drawback, as they open the path for tunneling devices in many THz applications, and avoid further device downscaling.


title: Correlated evolution: models and methods

abstract: In this article, we review the different models and methods to understand and estimate correlated evolution within the same genome, individual or species. We describe correlated evolution among traits, among genetic components and finally between traits and genetics.


title: Flipping Linear Algebra using a MOOC platform

abstract: Between 2017 and 2019, a standard Linear Algebra course from Instituto Superior T\'ecnico, University of Lisbon, used virtual learning content, mainly videos and formative assessment, delivered at the institution's MOOC platform to support a flipped classroom strategy. This strategy has involved around 100 first-year Computer Science enrolled students each year and was implemented by a faculty member of the Department of Mathematics. The flipped classroom was pedagogically developed and underwent new evaluations each year, with positive impacts on the way students and teachers work during the semester, within the context of teaching/learning mathematics. We will present and discuss the improvements and the results of this three-year hybrid experiment, analysing data from students' responses to questionnaires, online course completion rates, and data collected from students' final grades in the Linear Algebra course. Based on the findings, we have reason to believe that similar flipped classroom practices are a good response to the necessary changes in higher education towards more student-centred practices, especially in the areas of STEM higher education.


title: MasakhaNER: Named Entity Recognition for African Languages

abstract: We take a step towards addressing the under-representation of the African continent in NLP research by creating the first large publicly available high-quality dataset for named entity recognition (NER) in ten African languages, bringing together a variety of stakeholders. We detail characteristics of the languages to help researchers understand the challenges that these languages pose for NER. We analyze our datasets and conduct an extensive empirical evaluation of state-of-the-art methods across both supervised and transfer learning settings. We release the data, code, and models in order to inspire future research on African NLP.


title: Analysis of reliability systems via Gini-type index

abstract: Different strategies of reliability theory for the analysis of coherent systems have been studied by various researchers. Here, the Gini-type index is utilized as an applicable tool for the study and comparison of the ageing properties of complex systems. A new stochastic order in terms of Gini-type index is introduced to compare the speed of ageing of components and systems. The parallel-series and series-parallel systems with shared components are studied by their corresponding Gini-type indexes. Also, the generalization of Gini-type index for the multidimensional case is discussed, and is used to compare components lifetimes properties in the presence of other dependent components. It is shown that the ageing properties of a component lifetime can differ when the other components are working or have already failed. Numerous illustrative examples are given for better intuition of Gini-type and generalized Gini-type indexes throughout the paper.


title: An abundance theorem for generalised pairs

abstract: We prove the finiteness of $B$-representations of generalised log canonical pairs. As a consequence, we prove that, the (relative) abundance for a generalised semi-log canonical pair is implied by the abundance for its normalisation. Furthermore, we obtain an abundance theorem for generalised dlt pairs with abundant data, which is a natural inductive step of generalised minimal model program.


title: Double-Hit Signature of Millicharged Particles in 3D segmented neutrino detector

abstract: We calculate the production of hypothetical millicharged particles (MCPs) of sub-GeV masses by the J-PARC proton beam in the framework of T2K and future T2HK neutrino oscillation experiments. Concentrating on the region of model parameter space, where an MCP can hit the near neutrino detector twice, we adopt this background-free signature to estimate the sensitivity of T2K and T2HK experiments to MCPs. We find that a previously inaccessible in direct searches region of charges 5$\times$$10^{-4}$-$10^{-2}$ $e$ for MCP masses 0.1-0.5 GeV can be probed.


title: The ADM version of GR at Sixty: a brief account for historians

abstract: I review the meaning of General Relativity (GR), viewed as a dynamical field, rather than as geometry, as effected by the 1958-61 anti-geometrical work of ADM. This very brief non-technical summary, is intended for historians.


title: Incorporating Convolution Designs into Visual Transformers

abstract: Motivated by the success of Transformers in natural language processing (NLP) tasks, there emerge some attempts (e.g., ViT and DeiT) to apply Transformers to the vision domain. However, pure Transformer architectures often require a large amount of training data or extra supervision to obtain comparable performance with convolutional neural networks (CNNs). To overcome these limitations, we analyze the potential drawbacks when directly borrowing Transformer architectures from NLP. Then we propose a new \textbf{Convolution-enhanced image Transformer (CeiT)} which combines the advantages of CNNs in extracting low-level features, strengthening locality, and the advantages of Transformers in establishing long-range dependencies. Three modifications are made to the original Transformer: \textbf{1)} instead of the straightforward tokenization from raw input images, we design an \textbf{Image-to-Tokens (I2T)} module that extracts patches from generated low-level features; \textbf{2)} the feed-froward network in each encoder block is replaced with a \textbf{Locally-enhanced Feed-Forward (LeFF)} layer that promotes the correlation among neighboring tokens in the spatial dimension; \textbf{3)} a \textbf{Layer-wise Class token Attention (LCA)} is attached at the top of the Transformer that utilizes the multi-level representations. Experimental results on ImageNet and seven downstream tasks show the effectiveness and generalization ability of CeiT compared with previous Transformers and state-of-the-art CNNs, without requiring a large amount of training data and extra CNN teachers. Besides, CeiT models also demonstrate better convergence with $3\times$ fewer training iterations, which can reduce the training cost significantly\footnote{Code and models will be released upon acceptance.}.


title: Magnetically charged stars with nonlinear electrodynamics

abstract: In this research, we introduce magnetically charged stars in the framework of non-singular metric which is explained with nonlinear electrodynamics(NED). This model allows us to have an upper limit for the maximum limit for the mass of stars in the presence of NED. We explain our model for magnetized compact object by considering the polytropic equation of states(EoS)


title: Combinatorial Characterizations and Impossibilities for Higher-order Homophily

abstract: Homophily is the seemingly ubiquitous tendency for people to connect and interact with other individuals who are similar to them. This is a well-documented principle and is fundamental for how society organizes. Although many social interactions occur in groups, homophily has traditionally been measured using a graph model, which only accounts for pairwise interactions involving two individuals. Here, we develop a framework using hypergraphs to quantify homophily from group interactions. This reveals natural patterns of group homophily that appear with gender in scientific collaboration and political affiliation in legislative bill co-sponsorship, and also reveals distinctive gender distributions in group photographs, all of which cannot be fully captured by pairwise measures. At the same time, we show that seemingly natural ways to define group homophily are combinatorially impossible. This reveals important pitfalls to avoid when defining and interpreting notions of group homophily, as higher-order homophily patterns are governed by combinatorial constraints that are independent of human behavior but are easily overlooked.


title: Order, Disorder, and Transitions in Decorated AKLT States on Bethe Lattices

abstract: Returning to one of the original generalizations of the AKLT state, we extend prior analysis on the Bethe lattice (or Cayley tree) to a variant with a series of $n$ spin-1 decorations placed on each edge. The recurrence relations derived for this system demonstrate that such systems are critical for coordination numbers $z=3^{n+1}$, demonstrating order for greater and disorder for lesser coordination number. We then generalize further, effectively interpolating between systems with different values of $n$, using two realizations, one isotropic under local $SU(2)$ transformations and one anisotropic. Exact analysis of these recurrence relations allows us to deduce the location and behavior of order-disorder phase transitions for $z>4$.

categories: cond-mat.stat-mech math-ph math.MP quant-ph


title: GPNAS: A Neural Network Architecture Search Framework Based on Graphical Predictor

abstract: In practice, the problems encountered in Neural Architecture Search (NAS) training are not simple problems, but often a series of difficult combinations (wrong compensation estimation, curse of dimension, overfitting, high complexity, etc.). In this paper, we propose a framework to decouple network structure from operator search space, and use two BOHBs to search alternatively. Considering that activation function and initialization are also important parts of neural network, the generalization ability of the model will be affected. We introduce an activation function and an initialization method domain, and add them into the operator search space to form a generalized search space, so as to improve the generalization ability of the child model. We then trained a GCN-based predictor using feedback from the child model. This can not only improve the search efficiency, but also solve the problem of dimension curse. Next, unlike other NAS studies, we used predictors to analyze the stability of different network structures. Finally, we applied our framework to neural structure search and achieved significant improvements on multiple datasets.


title: Regenerativity of Viterbi process for pairwise Markov models

abstract: For hidden Markov models one of the most popular estimates of the hidden chain is the Viterbi path -- the path maximising the posterior probability. We consider a more general setting, called the pairwise Markov model (PMM), where the joint process consisting of finite-state hidden process and observation process is assumed to be a Markov chain. It has been recently proven that under some conditions the Viterbi path of the PMM can almost surely be extended to infinity, thereby defining the infinite Viterbi decoding of the observation sequence, called the Viterbi process. This was done by constructing a block of observations, called a barrier, which ensures that the Viterbi path goes trough a given state whenever this block occurs in the observation sequence. In this paper we prove that the joint process consisting of Viterbi process and PMM is regenerative. The proof involves a delicate construction of regeneration times which coincide with the occurrences of barriers. As one possible application of our theory, some results on the asymptotics of the Viterbi training algorithm are derived.


title: Graphic relation between amplitude and sound intensity level

abstract: We present a simple experiment that allows us to demonstrate graphically that the intensity of sound waves is proportional to the square of their amplitude, a result that is theoretically analysed in any introductory wave course but rarely demonstrated empirically. To achieve our goal, we use an audio signal generator that, when connected to a loudspeaker, produces sine waves that can be easily observed and measured using an oscilloscope. The measurements made with these instruments allow us to create a plot of amplitude versus sound intensity level, which verifies the mathematical relationship between amplitude and intensity mentioned above. Among the experimental errors, the plot obtained is in excellent agreement with what is theoretically expected.


title: Self-Organizing mmWave MIMO Cell-Free Networks With Hybrid Beamforming: A Hierarchical DRL-Based Design

abstract: In a cell-free wireless network, distributed access points (APs) jointly serve all user equipments (UEs) within the their coverage area by using the same time/frequency resources. In this paper, we develop a novel downlink cell-free multiple-input multiple-output (MIMO) millimeter wave (mmWave) network architecture that enables all APs and UEs to dynamically self-partition into a set of independent cell-free subnetworks in a time-slot basis. For this, we propose several network partitioning algorithms based on deep reinforcement learning (DRL). Furthermore, to mitigate interference between different cell-free subnetworks, we develop a novel hybrid analog beamsteering-digital beamforming model that zero-forces interference among cell-free subnetworks and at the same time maximizes the instantaneous sum-rate of all UEs within each subnetwork. Specifically, the hybrid beamforming model is implemented by using a novel mixed DRL-convex optimization method in which analog beamsteering between APs and UEs is conducted based on DRL while digital beamforming is modeled and solved as a convex optimization problem. The DRL models for network clustering and hybrid beamsteering are combined into a single hierarchical DRL design that enables exchange of DRL agents' experiences during both network training and operation. We also benchmark the performance of DRL models for clustering and beamsteering in terms of network performance, convergence rate, and computational complexity.


title: Big Data for Traffic Estimation and Prediction: A Survey of Data and Tools

abstract: Big data has been used widely in many areas including the transportation industry. Using various data sources, traffic states can be well estimated and further predicted for improving the overall operation efficiency. Combined with this trend, this study presents an up-to-date survey of open data and big data tools used for traffic estimation and prediction. Different data types are categorized and the off-the-shelf tools are introduced. To further promote the use of big data for traffic estimation and prediction tasks, challenges and future directions are given for future studies.


title: From Digital Humanities to Quantum Humanities: Potentials and Applications

abstract: Quantum computers are becoming real. Therefore, it is promising to use their potentials in different applications areas, which includes research in the humanities. Due to an increasing amount of data that needs to be processed in the digital humanities the use of quantum computers can contribute to this research area. To give an impression on how beneficial such involvement of quantum computers can be when analyzing data from the humanities, a use case from the media science is presented. Therefore, both the theoretical basis and the tooling support for analyzing the data from our digital humanities project MUSE is described. This includes a data analysis pipeline, containing e.g. various approaches for data preparation, feature engineering, clustering, and classification where several steps can be realized classically, but also supported by quantum computers.


title: Anisotropic Scalar Field Dark Energy with a Disformally Coupled Yang-Mills Field

abstract: In the context of scalar-tensor theories, the inclusion of new degrees of freedom coupled non-minimally to the gravitational sector might produce some appealing effects on the cosmic expansion history. We investigate this premise by including a canonical SU(2) Yang- Mills field to the total energy budget of the universe coupled to the standard quintessential field by a disformal transformation. From the dynamical system analysis, we study three cases of cosmological interest that span most of the physical phase space of the model: the uncoupled limit, the isotropic, and the Abelian cases. New scaling solutions with a non-vanishing gauge field are found in all cases which can be interesting for early cosmological scenarios. Some of these scaling solutions even exhibit anisotropic features. Also, the background evolution of the universe is studied by means of numerical analysis. As an interesting result, the disformal coupling changes the equation of state of the gauge field from radiation to matter at some stages of the evolution of the universe, thereby the gauge field can contribute to some fraction of the total dark matter. We have also quantified the redshift-dependent contribution of the gauge field in the form of dark radiation during the radiation era to the effective number of relativistic species. This depends essentially on the initial conditions and, more importantly, on the disformal coupling function.


title: Existence, stability and long time behaviour of weak solutions of the three-dimensional compressible Navier-Stokes equations with potential force

abstract: We address the global-in-time existence, stability and long time behaviour of weak solutions of the three-dimensional compressible Navier-Stokes equations with potential force. We show the details of the $\alpha$-dependence of different smoothing rates for weak solutions near $t=0$ under the assumption on the initial velocity $u_0$ that $u_0\in H^\alpha$ for $\alpha\in(\frac{1}{2},1]$ and obtain long time convergence of weak solutions in various norms. We then make use of the Lagrangean framework in comparing the instantaneous states of corresponding fluid particles in two different solutions. The present work provides qualitative results on the long time behaviour of weak solutions and how the weak solutions depend continuously on initial data and steady states.


title: The power-law distribution in the geometrically growing system: Statistic of the COVID-19 pandemic

abstract: The power-law distribution is ubiquitous and its mechanism seems to be various. We find a general mechanism for the distribution. The distribution of a geometrically growing system can be approximated by a log - completely squared chi distribution with 1 degree of freedom (log-CS$\chi_1$), which reaches asymptotically a power-law distribution, or by a log-normal distribution, which has an infinite asymptotic slope, at the upper limit. For the log-CS$\chi_1$, the asymptotic exponent of the power-law or the slope in a log-log diagram seems to be related only to the variances of the system parameters and their mutual correlation but independent of an initial distribution of the system or any mean value of parameters. We can take the log-CS$\chi_1$ as a unique approximation when the system should have a singular initial distribution. The mechanism shows a comprehensiveness to be applicable to wide practice. We derive a simple formula for the Zipf's exponent, which will probably demand that the exponent should be near -1 rather than exactly -1. We show that this approach can explain statistics of the COVID-19 pandemic.


title: DemirciPro's tools for completing the Linac: Ion source and LEBT line

abstract: Demirci RFQ design software has been enlarged to perform other design tasks pertinent to the initial part of a linac. These are the design of an ion source, the design of a low energy beam transmission line including the re alistic design of its magnets and finally the design of a pepper pot emittance meter. This note presents these latest developments together with some examples from a linac being developed in KahveLab, Turkey.


title: High-Dimensional Covariance Shrinkage for Signal Detection

abstract: In this paper, we consider the problem of determining the presence of a given signal in a high-dimensional observation with unknown covariance matrix by using an adaptive matched filter. Traditionally such filters are formed from the sample covariance matrix of some given training data, but, as is well-known, the performance of such filters is poor when the number of training data $n$ is not much larger than the data dimension $p$. We thus seek a covariance estimator to replace sample covariance. To account for the fact that $n$ and $p$ may be of comparable size, we adopt the "large-dimensional asymptotic model" in which $n$ and $p$ go to infinity in a fixed ratio. Under this assumption, we identify a covariance estimator that is asymptotically detection-theoretic optimal within a general shrinkage class inspired by C. Stein, and we give consistent estimates for conditional false-alarm and detection rate of the corresponding adaptive matched filter.


title: Endomorphisms of the projective plane and the image of the Suslin-Hurewicz map

abstract: The endomorphism ring of the projective plane over a field F of characteristic neither two nor three is slightly more complicated in the Morel-Voevodsky motivic stable homotopy category than in Voevodsky's derived category of motives. In particular, it is not commutative precisely if there exists a square in F which does not admit a sixth root. A byproduct of the computations is a proof of Suslin's conjecture on the Suslin-Hurewicz homomorphism from Quillen to Milnor K-theory in degree four, based on work of Asok, Fasel, and Williams.


title: Deep RGB-D Saliency Detection with Depth-Sensitive Attention and Automatic Multi-Modal Fusion

abstract: RGB-D salient object detection (SOD) is usually formulated as a problem of classification or regression over two modalities, i.e., RGB and depth. Hence, effective RGBD feature modeling and multi-modal feature fusion both play a vital role in RGB-D SOD. In this paper, we propose a depth-sensitive RGB feature modeling scheme using the depth-wise geometric prior of salient objects. In principle, the feature modeling scheme is carried out in a depth-sensitive attention module, which leads to the RGB feature enhancement as well as the background distraction reduction by capturing the depth geometry prior. Moreover, to perform effective multi-modal feature fusion, we further present an automatic architecture search approach for RGB-D SOD, which does well in finding out a feasible architecture from our specially designed multi-modal multi-scale search space. Extensive experiments on seven standard benchmarks demonstrate the effectiveness of the proposed approach against the state-of-the-art.


title: AutoSpace: Neural Architecture Search with Less Human Interference

abstract: Current neural architecture search (NAS) algorithms still require expert knowledge and effort to design a search space for network construction. In this paper, we consider automating the search space design to minimize human interference, which however faces two challenges: the explosive complexity of the exploration space and the expensive computation cost to evaluate the quality of different search spaces. To solve them, we propose a novel differentiable evolutionary framework named AutoSpace, which evolves the search space to an optimal one with following novel techniques: a differentiable fitness scoring function to efficiently evaluate the performance of cells and a reference architecture to speedup the evolution procedure and avoid falling into sub-optimal solutions. The framework is generic and compatible with additional computational constraints, making it feasible to learn specialized search spaces that fit different computational budgets. With the learned search space, the performance of recent NAS algorithms can be improved significantly compared with using previously manually designed spaces. Remarkably, the models generated from the new search space achieve 77.8% top-1 accuracy on ImageNet under the mobile setting (MAdds < 500M), out-performing previous SOTA EfficientNet-B0 by 0.7%. All codes will be made public.


title: Generation and Simulation of Yeast Microscopy Imagery with Deep Learning

abstract: Time-lapse fluorescence microscopy (TLFM) is an important and powerful tool in synthetic biological research. Modeling TLFM experiments based on real data may enable researchers to repeat certain experiments with minor effort. This thesis is a study towards deep learning-based modeling of TLFM experiments on the image level. The modeling of TLFM experiments, by way of the example of trapped yeast cells, is split into two tasks. The first task is to generate synthetic image data based on real image data. To approach this problem, a novel generative adversarial network, for conditionalized and unconditionalized image generation, is proposed. The second task is the simulation of brightfield microscopy images over multiple discrete time-steps. To tackle this simulation task an advanced future frame prediction model is introduced. The proposed models are trained and tested on a novel dataset that is presented in this thesis. The obtained results showed that the modeling of TLFM experiments, with deep learning, is a proper approach, but requires future research to effectively model real-world experiments.


title: Bridging the gap between supervised classification and unsupervised topic modelling for social-media assisted crisis management

abstract: Social media such as Twitter provide valuable information to crisis managers and affected people during natural disasters. Machine learning can help structure and extract information from the large volume of messages shared during a crisis; however, the constantly evolving nature of crises makes effective domain adaptation essential. Supervised classification is limited by unchangeable class labels that may not be relevant to new events, and unsupervised topic modelling by insufficient prior knowledge. In this paper, we bridge the gap between the two and show that BERT embeddings finetuned on crisis-related tweet classification can effectively be used to adapt to a new crisis, discovering novel topics while preserving relevant classes from supervised training, and leveraging bidirectional self-attention to extract topic keywords. We create a dataset of tweets from a snowstorm to evaluate our method's transferability to new crises, and find that it outperforms traditional topic models in both automatic, and human evaluations grounded in the needs of crisis managers. More broadly, our method can be used for textual domain adaptation where the latent classes are unknown but overlap with known classes from other domains.


title: Associated varieties for real reductive groups

abstract: We give an algorithm to compute the associated variety of a Harish- Chandra module for a real reductive group $G({\mathbb R})$. The algorithm is implemented in the atlas software package.


title: Properties of Breuil-Kisin modules inherited by $p$-divisible groups

abstract: In this paper, by assuming a faithful action of a finite flat $\mathbb{Z}_p$-algebra $\mathscr{R}$ on a $p$-divisible group $\mathcal{G}$ defined over the ring of $p$-adic integers $\mathscr{O}_K$, we construct a category of new Breuil-Kisin module $\mathfrak{M}$ defined over the ring $\mathfrak{S}:=W(\kappa)[\![u]\!]$ and study the freeness and projectiveness properties of such a module.


title: Spin-dependent optical excitations in LiFeO2

abstract: The three-dimensional ternary LiFeO2 compound presents various unusual essential properties. The main features are thoroughly explored by the density functional and many-body perturbation theory. The concise physical/chemical picture, the critical spin-polarizations and orbital hybridizations in the Li-O and Fe-O bonds, are clearly examined through geometric optimization, quasi-particle energy spectra, spin-polarized density of states, the spatial charge densities, the spin-density distributions, and the strong optical responses. The unusual optical transitions cover various frequency-dependent absorption structures, and the most prominent plasmon modes are identified by the dielectric functions, energy loss functions, reflectance spectra, and absorption coefficients. Optical excitations are anisotropic and strongly affected by excitonic effects. The close combinations of electronic, magnetic and optical properties allow us to identify the significant spin-polarizations and orbital hybridizations for each available excitation channel. The lithium ferrite compound can be used for spintronic and photo-catalysis applications.


title: Explicit evaluation of some integrals involving polylogarithm functions

abstract: In this paper, we give explicit evaluation for some integrals involving polylogarithm functions of types $\int_{0}^{x}t^{m} Li_{p}(t)\mathrm{d}t$ and $\int_{0}^{x}\log^{m}(t) Li_{p}(t)\mathrm{d}t$. Some more integrals involving the logarithm function will also be derived.


title: A Twistor Space Action for Yang-Mills Theory

abstract: We consider the twistor space ${\cal P}^6\cong{\mathbb R}^4{\times}{\mathbb C}P^1$ of ${\mathbb R}^4$ with a non-integrable almost complex structure ${\cal J}$ such that the canonical bundle of the almost complex manifold $({\cal P}^6, {\cal J})$ is trivial. It is shown that ${\cal J}$-holomorphic Chern-Simons theory on a real $(6|2)$-dimensional graded extension ${\cal P}^{6|2}$ of the twistor space ${\cal P}^6$ is equivalent to self-dual Yang-Mills theory on Euclidean space ${\mathbb R}^4$ with Lorentz invariant action. It is also shown that adding a local term to a Chern-Simons-type action on ${\cal P}^{6|2}$, one can extend it to a twistor action describing full Yang-Mills theory.


title: Asymptotic Coefficients and Errors for Chebyshev Polynomial Approximations with Weak Endpoint Singularities: Effects of Different Bases

abstract: When solving differential equations by a spectral method, it is often convenient to shift from Chebyshev polynomials $T_{n}(x)$ with coefficients $a_{n}$ to modified basis functions that incorporate the boundary conditions. For homogeneous Dirichlet boundary conditions, $u(\pm 1)=0$, popular choices include the ``Chebyshev difference basis", $\varsigma_{n}(x) \equiv T_{n+2}(x) - T_{n}(x)$ with coefficients here denoted $b_{n}$ and the ``quadratic-factor basis functions" $\varrho_{n}(x) \equiv (1-x^{2}) T_{n}(x)$ with coefficients $c_{n}$. If $u(x)$ is weakly singular at the boundaries, then $a_{n}$ will decrease proportionally to $\mathcal{O}(A(n)/n^{\kappa})$ for some positive constant $\kappa$, where the $A(n)$ is a logarithm or a constant. We prove that the Chebyshev difference coefficients $b_{n}$ decrease more slowly by a factor of $1/n$ while the quadratic-factor coefficients $c_{n}$ decrease more slowly still as $\mathcal{O}(A(n)/n^{\kappa-2})$. The error for the unconstrained Chebyshev series, truncated at degree $n=N$, is $\mathcal{O}(|A(N)|/N^{\kappa})$ in the interior, but is worse by one power of $N$ in narrow boundary layers near each of the endpoints. Despite having nearly identical error \emph{norms}, the error in the Chebyshev basis is concentrated in boundary layers near both endpoints, whereas the error in the quadratic-factor and difference basis sets is nearly uniform oscillations over the entire interval in $x$. Meanwhile, for Chebyshev polynomials and the quadratic-factor basis, the value of the derivatives at the endpoints is $\mathcal{O}(N^{2})$, but only $\mathcal{O}(N)$ for the difference basis.


title: Dirac-Witten Operators and the Kastler-Kalau-Walze type theorem for manifolds with boundary

abstract: In this paper, we obtain two Lichnerowicz type formulas for the Dirac-Witten operators. And we give the proof of Kastler-Kalau-Walze type theorems for the Dirac-Witten operators on 4-dimensional and 6- dimensional compact manifolds with (resp.without) boundary


title: Implementation of Artificial Neural Networks for the Nepta-Uranian Interplanetary (NUIP) Mission

abstract: A celestial alignment between Neptune, Uranus, and Jupiter will occur in the early 2030s, allowing a slingshot around Jupiter to gain enough momentum to achieve planetary flyover capability around the two ice giants. The launch of the uranian probe for the departure windows of the NUIP mission is between January 2030 and January 2035, and the duration of the mission is between six and ten years, and the launch of the Nepta probe for the departure windows of the NUIP mission is between February 2031 and April 2032 and the duration of the mission is between seven and ten years. To get the most out of alignment, deep learning methods are expected to play a critical role in autonomous and intelligent spatial guidance problems. This would reduce travel time, hence mission time, and allow the spacecraft to perform well for the life of its sophisticated instruments and power systems up to fifteen years. This article proposes a design of deep neural networks, namely convolutional neural networks and recurrent neural networks, capable of predicting optimal control actions and image classification during the mission. Nepta-Uranian interplanetary mission, using only raw images taken by optimal onboard cameras. It also describes the unique requirements and constraints of the NUIP mission, which led to the design of the communications system for the Nepta-Uranian spacecraft. The proposed mission is expected to collect telemetry data on Uranus and Neptune while performing the flyovers and transmit the obtained data to Earth for further analysis. The advanced range of spectrometers and particle detectors available would allow better quantification of the ice giant's properties.


title: Bell nonlocality between sequential pairs of observers

abstract: We show that it is possible to have arbitrarily long sequences of Alices and Bobs so every (Alice, Bob) pair violates a Bell inequality. We propose an experiment to observe this effect with two Alices and two Bobs.


title: Learning to Simulate on Sparse Trajectory Data

abstract: Simulation of the real-world traffic can be used to help validate the transportation policies. A good simulator means the simulated traffic is similar to real-world traffic, which often requires dense traffic trajectories (i.e., with a high sampling rate) to cover dynamic situations in the real world. However, in most cases, the real-world trajectories are sparse, which makes simulation challenging. In this paper, we present a novel framework ImInGAIL to address the problem of learning to simulate the driving behavior from sparse real-world data. The proposed architecture incorporates data interpolation with the behavior learning process of imitation learning. To the best of our knowledge, we are the first to tackle the data sparsity issue for behavior learning problems. We investigate our framework on both synthetic and real-world trajectory datasets of driving vehicles, showing that our method outperforms various baselines and state-of-the-art methods.


title: K\"all\'en-Lehmann Spectral Representation of the Scalar SU(2) Glueball

abstract: The estimation of the K\"all\'en-Lehmann spectral density from gauge invariant lattice QCD two point correlation functions is proposed, and explored via an appropriate inversion method. As proof of concept the SU(2) glueball spectrum for the quantum numbers $J^{PC} = 0^{++}$ is investigated for various values of the lattice spacing. The spectral density and the glueball spectrum are estimated using the published data of arXiv:1910.07756. Our estimates for the ground state mass are in good agreement with the traditional approach published therein, which is based on the large time exponential behaviour of the correlation functions. Furthermore, the spectral density also contains hints of excites states in the spectrum.


title: Discrete cosine transform LSQR and GMRES methods for multidimensional ill-posed problems

abstract: In the present work, we propose new tensor Krylov subspace method for ill posed linear tensor problems such as in color or video image restoration. Those methods are based on the tensor-tensor discrete cosine transform that gives fast tensor-tensor product computations. In particular, we will focus on the tensor discrete cosine versions of GMRES, Golub-Kahan bidiagonalisation and LSQR methods. The presented numerical tests show that the methods are very fast and give good accuracies when solving some linear tensor ill-posed problems.


title: Effect of superconductivity on the shape of flat bands

abstract: For the first time, basing both on experimental facts and our theoretical consideration, we show that Fermi systems with flat bands should be tuned with the superconducting state. Experimental measurements on magic-angle twisted bilayer graphene of the Fermi velocity $V_F$ as a function of the temperature $T_c$ of superconduction phase transition have revealed $V_F\propto T_c\propto 1/N_s(0)$, where $N_s(0)$ is the density of states at the Fermi level. We show that the high-$T_c$ compounds $\rm Bi_2Sr_2CaCu_2O_{8+x}$ exhibit the same behavior. Such observation is a challenge to theories of high-$T_c$ superconductivity, since $V_F$ is negatively correlated with $T_c$, for $T_c\propto 1/V_F\propto N_s(0)$. We show that the theoretical idea of forming flat bands in strongly correlated Fermi systems can explain this behavior and other experimental data collected on both $\rm Bi_2Sr_2CaCu_2O_{8+x}$ and twisted bilayer graphene. Our findings place stringent constraints on theories describing the nature of high-$T_c$ superconductivity and the deformation of flat band by the superconducting phase transition.


title: Almost (Weighted) Proportional Allocations for Indivisible Chores

abstract: In this paper, we study how to fairly allocate m indivisible chores to n (asymmetric) agents. We consider (weighted) proportionality up to any item (PROPX) and show that a (weighted) PROPX allocation always exists and can be computed efficiently. For chores, we argue that PROPX might be a more reliable relaxation for proportionality by the facts that any PROPX allocation ensures 2-approximation of maximin share (MMS) fairness [Budish, 2011] for symmetric agents and of anyprice share (APS) fairness [Babaioff et al, 2021] for asymmetric agents. APS allocations for chores have not been studied before the current work, and our result implies a 2-approximation algorithm. Another by-product result is that an EFX and a weighted EF1 allocation for indivisible chores exist if all agents have the same ordinal preference, which might be of independent interest. We then consider the partial information setting and design algorithms that only use agents' ordinal preferences to compute approximately PROPX allocations. Our algorithm achieves a 2-approximation for both symmetric and asymmetric agents, and the approximation ratio is optimal. Finally, we study the price of fairness (PoF), i.e., the loss in social welfare by enforcing allocations to be (weighted) PROPX. We prove that the tight ratio for PoF is Theta(n) for symmetric agents and unbounded for asymmetric agents.


title: Monitoring Covid-19 on social media using a novel triage and diagnosis approach

abstract: Objective: This study aims to develop an end-to-end natural language processing pipeline for triage and diagnosis of COVID-19 from patient-authored social media posts, in order to provide researchers and public health practitioners with additional information on the symptoms, severity and prevalence of the disease rather than to provide an actionable decision at the individual level. Materials and Methods: The text processing pipeline first extracts COVID-19 symptoms and related concepts such as severity, duration, negations, and body parts from patients' posts using conditional random fields. An unsupervised rule-based algorithm is then applied to establish relations between concepts in the next step of the pipeline. The extracted concepts and relations are subsequently used to construct two different vector representations of each post. These vectors are applied separately to build support vector machine learning models to triage patients into three categories and diagnose them for COVID-19. Results: We report that macro- and micro-averaged F1 scores in the range of 71-96% and 61-87%, respectively, for the triage and diagnosis of COVID-19, when the models are trained on human labelled data. Our experimental results indicate that similar performance can be achieved when the models are trained using predicted labels from concept extraction and rule-based classifiers, thus yielding end-to-end machine learning. Also, we highlight important features uncovered by our diagnostic machine learning models and compare them with the most frequent symptoms revealed in another COVID-19 dataset. In particular, we found that the most important features are not always the most frequent ones.


title: Data-driven output synchronization of heterogeneous leader-follower multi-agent systems

abstract: This paper deals with data-driven output synchronization for heterogeneous leader-follower linear multi-agent systems. Given a multi-agent system that consists of one autonomous leader and a number of heterogeneous followers with external disturbances, we provide necessary and sufficient data-based conditions for output synchronization. We also provide a design method for obtaining such output synchronizing protocols directly from data. The results are then extended to the special case that the followers are disturbance-free. Finally, a simulation example is provided to illustrate our results.


title: Detecting Racial Bias in Jury Selection

abstract: To support the 2019 U.S. Supreme Court case "Flowers v. Mississippi", APM Reports collated historical court records to assess whether the State exhibited a racial bias in striking potential jurors. This analysis used backward stepwise logistic regression to conclude that race was a significant factor, however this method for selecting relevant features is only a heuristic, and additionally cannot consider interactions between features. We apply Optimal Feature Selection to identify the globally-optimal subset of features and affirm that there is significant evidence of racial bias in the strike decisions. We also use Optimal Classification Trees to segment the juror population subgroups with similar characteristics and probability of being struck, and find that three of these subgroups exhibit significant racial disparity in strike rate, pinpointing specific areas of bias in the dataset.


title: Studying Moral-based Differences in the Framing of Political Tweets

abstract: In this paper, we study the moral framing of political content on Twitter. Specifically, we examine differences in moral framing in two datasets: (i) tweets from US-based politicians annotated with political affiliation and (ii) COVID-19 related tweets in German from followers of the leaders of the five major Austrian political parties. Our research is based on recent work that introduces an unsupervised approach to extract framing bias and intensity in news using a dictionary of moral virtues and vices. In this paper, we use a more extensive dictionary and adapt it to German-language tweets. Overall, in both datasets, we observe a moral framing that is congruent with the public perception of the political parties. In the US dataset, democrats have a tendency to frame tweets in terms of care, while loyalty is a characteristic frame for republicans. In the Austrian dataset, we find that the followers of the governing conservative party emphasize care, which is a key message and moral frame in the party's COVID-19 campaign slogan. Our work complements existing studies on moral framing in social media. Also, our empirical findings provide novel insights into moral-based framing on COVID-19 in Austria.


title: Existence of breathers in nonlinear Klein-Gordon lattices

abstract: We prove the existence of time-periodic solutions and spatially localised solutions (breathers), in general nonlinear Klein-Gordon infinite lattices. The existence problem is converted into a fixed point problem for an operator on some appropriate function space which is solved by means of Schauder's Fixed Point Theorem.


title: Search for the decay $D_s^+\to a_0(980)^0e^+\nu_e$

abstract: Using 6.32 fb$^{-1}$ of electron-positron collision data recorded by the BESIII detector at center-of-mass energies between 4.178 and 4.226~GeV, we present the first search for the decay $D_s^+\to a_0(980)^0 e^+\nu_e,\,a_0(980)^0\rightarrow \pi^0\eta$, which could proceed via $a_0(980)$-$f_0(980)$ mixing. No significant signal is observed. An upper limit of $1.2 \times 10^{-4}$ at the $90\%$ confidence level is set on the product of the branching fractions of $D_{s}^{+}\to a_0(980)^0 e^+\nu_e$ and $a_0(980)^0\rightarrow \pi^0\eta$ decays.


title: A Link between Coding Theory and Cross-Validation with Applications

abstract: How many different binary classification problems a single learning algorithm can solve on a fixed data with exactly zero or at most a given number of cross-validation errors? While the number in the former case is known to be limited by the no-free-lunch theorem, we show that the exact answers are given by the theory of error detecting codes. As a case study, we focus on the AUC performance measure and leave-pair-out cross-validation (LPOCV), in which every possible pair of data with different class labels is held out at a time. We show that the maximal number of classification problems with fixed class proportion, for which a learning algorithm can achieve zero LPOCV error, equals the maximal number of code words in a constant weight code (CWC), with certain technical properties. We then generalize CWCs by introducing light CWCs, and prove an analogous result for nonzero LPOCV errors and light CWCs. Moreover, we prove both upper and lower bounds on the maximal numbers of code words in light CWCs. Finally, as an immediate practical application, we develop new LPOCV based randomization tests for learning algorithms that generalize the classical Wilcoxon-Mann-Whitney U test.


title: Quantum Zeno Effect in Heisenberg Picture and Critical Measurement Time

abstract: Quantum Zeno effect is conventionally interpreted by the assumption of the wave-packet collapse, in which does not involve the duration of measurement. However, we predict duration $\tau_m$ of each measurement will appear in quantum Zeno effect by a dynamical approach. Moreover, there exists a model-free critical measurement time, which quantum Zeno effect does not occur when $\tau_m$ takes some special values. In order to give these predictions, we first present a description of quantum Zeno effect in the Heisenberg picture, which is based on the expectation value of an observable and its fluctuation. Then we present a general proof for quantum Zeno effect in the Heisenberg picture, which is independent of the concrete systems. Finally, we calculate the average population and relative fluctuation after $N$ successive measurements in XX model, which agrees with our prediction about the critical measurement time.


title: Localization in optical systems with an intensity-dependent dispersion

abstract: We address the nonlinear Schrodinger equation with intensity-dependent dispersion which was recently proposed in the context of nonlinear optical systems. Contrary to the previous findings, we prove that no solitary wave solutions exist if the sign of the intensity-dependent dispersion coincides with the sign of the constant dispersion, whereas a continuous family of such solutions exists in the case of the opposite signs. The family includes two particular solutions, namely cusped and bell-shaped solitons, where the former represents the lowest energy state in the family and the latter is a limit of solitary waves in a regularized system. We further analyze the delicate analytical properties of these solitary waves such as the asymptotic behavior near singularities, the spectral stability, and the convergence of the fixed-point iterations near such solutions. The analytical theory is corroborated by means of numerical approximations.


title: Part of speech and gramset tagging algorithms for unknown words based on morphological dictionaries of the Veps and Karelian languages

abstract: This research devoted to the low-resource Veps and Karelian languages. Algorithms for assigning part of speech tags to words and grammatical properties to words are presented in the article. These algorithms use our morphological dictionaries, where the lemma, part of speech and a set of grammatical features (gramset) are known for each word form. The algorithms are based on the analogy hypothesis that words with the same suffixes are likely to have the same inflectional models, the same part of speech and gramset. The accuracy of these algorithms were evaluated and compared. 313 thousand Vepsian and 66 thousand Karelian words were used to verify the accuracy of these algorithms. The special functions were designed to assess the quality of results of the developed algorithms. 92.4% of Vepsian words and 86.8% of Karelian words were assigned a correct part of speech by the developed algorithm. 95.3% of Vepsian words and 90.7% of Karelian words were assigned a correct gramset by our algorithm. Morphological and semantic tagging of texts, which are closely related and inseparable in our corpus processes, are described in the paper.


title: Spatio-Temporal Neural Network for Fitting and Forecasting COVID-19

abstract: We established a Spatio-Temporal Neural Network, namely STNN, to forecast the spread of the coronavirus COVID-19 outbreak worldwide in 2020. The basic structure of STNN is similar to the Recurrent Neural Network (RNN) incorporating with not only temporal data but also spatial features. Two improved STNN architectures, namely the STNN with Augmented Spatial States (STNN-A) and the STNN with Input Gate (STNN-I), are proposed, which ensure more predictability and flexibility. STNN and its variants can be trained using Stochastic Gradient Descent (SGD) algorithm and its improved variants (e.g., Adam, AdaGrad and RMSProp). Our STNN models are compared with several classical epidemic prediction models, including the fully-connected neural network (BPNN), and the recurrent neural network (RNN), the classical curve fitting models, as well as the SEIR dynamical system model. Numerical simulations demonstrate that STNN models outperform many others by providing more accurate fitting and prediction, and by handling both spatial and temporal data.


title: A one-step blended soundproof-compressible model with balanced data assimilation: theory and idealised tests

abstract: A challenge arising from the local Bayesian assimilation of data in an atmospheric flow simulation is the imbalances it may introduce. Acoustic fast-mode imbalances of the order of the slower dynamics can be negated by employing a blended numerical model with seamless access to the compressible and the soundproof pseudo-incompressible dynamics. Here, the blended modelling strategy by Benacchio et al., MWR, vol. 142 (2014) is upgraded in an advanced numerical framework and extended with a Bayesian local ensemble data assimilation method. Upon assimilation of data, the model configuration is switched to the pseudo-incompressible regime for one time-step. After that, the model configuration is switched back to the compressible model for the duration of the assimilation window. The switching between model regimes is repeated for each subsequent assimilation window. An improved blending strategy for the numerical model ensures that a single time-step in the pseudo-incompressible regime is sufficient to suppress imbalances coming from the initialisation and data assimilation. This improvement is based on three innovations: (i) the association of pressure fields computed at different stages of the numerical integration with actual time levels; (ii) a conversion of pressure-related variables between the model regimes derived from low Mach number asymptotics; and (iii) a judicious selection of the pressure variables used in converting numerical model states when a switch of models occurs. Idealised two-dimensional travelling vortex and buoyancy-driven bubble convection experiments show that acoustic imbalances arising from data assimilation can be eliminated by using this blended model, thereby achieving balanced analysis fields.

categories: math.NA cs.NA physics.ao-ph physics.flu-dyn


title: Resilient Control under Quantization and Denial-of-Service: Co-designing a Deadbeat Controller and Transmission Protocol

abstract: This paper is concerned with the problem of stabilizing continuous-time linear time-invariant systems subject to quantization and Denial-of-Service (DoS) attacks. In this context, two DoS-induced challenges emerge with the design of resilient encoding schemes, namely, the coupling between encoding strategies of different signals, and the synchronization between the encoder and decoder. To address these challenges, a novel structure that is equipped with a deadbeat controller as well as a delicate transmission protocol for the input and output channels, co-designed leveraging the controllability index, is put forward. When both input and output channels are subject to DoS attacks and quantization, the proposed structure is shown able to decouple the encoding schemes for input, output, and estimated output signals. This property is further corroborated by designing encoding schemes as well as conditions that ensure exponential stability of the closed-loop system. On the other hand, when only the output channel is subject to network phenomenon, the proposed structure can achieve exponential stabilization without acknowledgment (ACK) signals, in contrast to existing ACK-based results. Finally, a numerical example is given to demonstrate the practical merits of the proposed approach as well as the theory.


title: Online search of unknown terrains using a dynamical system-based path planning approach

abstract: Surveillance and exploration of large environments is a tedious task. In spaces with limited environmental cues, random-like search is an effective approach as it allows the robot to perform online coverage of environments using simple algorithm designs. One way to generate random-like scanning search is to use nonlinear dynamical systems to impart chaos into the searching robot's controller. This will result in the generation of unpredictable yet deterministic trajectories, allowing designers to control the system and achieve a high scanning coverage of an area. However, the unpredictability comes at the cost of increased coverage time and a lack of scalability, both of which have been ignored by the state-of-the-art chaotic path planners. This work introduces a new, scalable technique that helps a robot to steer away from the obstacles and cover the entire search space in a short period of time. The technique involves coupling and manipulating two chaotic systems to reduce the coverage time and enable scanning of unknown environments with different online properties. Using this new technique resulted in an average 49% boost in the robot's performance compared to the state-of-the-art planners. the overall search performance of the chaotic planner remained comparable to optimal systems while still ensuring unpredictable paths.


title: Recovery of Joint Probability Distribution from one-way marginals: Low rank Tensors and Random Projections

abstract: Joint probability mass function (PMF) estimation is a fundamental machine learning problem. The number of free parameters scales exponentially with respect to the number of random variables. Hence, most work on nonparametric PMF estimation is based on some structural assumptions such as clique factorization adopted by probabilistic graphical models, imposition of low rank on the joint probability tensor and reconstruction from 3-way or 2-way marginals, etc. In the present work, we link random projections of data to the problem of PMF estimation using ideas from tomography. We integrate this idea with the idea of low-rank tensor decomposition to show that we can estimate the joint density from just one-way marginals in a transformed space. We provide a novel algorithm for recovering factors of the tensor from one-way marginals, test it across a variety of synthetic and real-world datasets, and also perform MAP inference on the estimated model for classification.


title: #LaCulturaNonsiFerma: Report on Use and Diffusion of #Hashtags from the Italian Cultural Institutions during the COVID-19 outbreak

abstract: This report presents an analysis of #hashtags used by Italian Cultural Heritage institutions to promote and communicate cultural content during the COVID-19 lock-down period in Italy. Several activities to support and engage users' have been proposed using social media. Most of these activities present one or more #hashtags which help to aggregate content and create a community on specific topics. Results show that on one side Italian institutions have been very proactive in adapting to the pandemic scenario and on the other side users' reacted very positively increasing their participation in the proposed activities.


title: Convergence from two-species Vlasov-Poisson-Boltzmann system to two-fluid incompressible Navier-Stokes-Fourier-Poisson system with Ohm's law

abstract: In this paper, we justify the convergence from the two-species Vlasov-Poisson-Boltzmann (in briefly,VPB) system to the two-fluid incompressible Navier-Stokes-Fourier-Poisson (in briefly, NSFP) system with Ohm's law in the context of classical solutions. We prove the uniform estimates with respect to the Knudsen number $\varepsilon$ for the solutions to the two-species VPB system near equilibrium by treating the strong interspecies interactions. Consequently, we prove the convergence to the two-fluid incompressible NSFP as $\varepsilon$ go to 0.


title: Measurement of the dynamic polarizability of Dy atoms near the 626-nm intercombination line

abstract: We report on measurements of the anisotropic dynamical polarizability of Dy near the 626-nm intercombination line, employing modulation spectroscopy in a one-dimensional optical lattice. To eliminate large systematic uncertainties resulting from the limited knowledge of the spatial intensity distribution, we use K as a reference species with accurately known polarizability. This method can be applied independently of the sign of the polarizability, i.e., for both attractive and repulsive optical fields on both sides of a resonance. By variation of the laser polarization we extract the scalar and the tensorial part. To characterize the strength of the transition, we also derive the natural linewidth. We find our result to be in excellent agreement with literature values, which provide a sensitive benchmark for the accuracy of our method. In addition we demonstrate optical dipole trapping on the intercombination line, confirming the expected long lifetimes and low heating rates. This provides an additional tool to tailor optical potentials for Dy atoms and for the species-specific manipulation of atoms in the Dy-K mixture.


title: Time-frequency analysis assisted reconstruction of ruthenium optical constants in the sub-EUV spectral range 8nm-23.75nm

abstract: The optical constants of ruthenium in the spectral range 8 nm to 23.75 nm with their corresponding uncertainties are derived from the reflectance of a sputtered ruthenium thin film in the Extreme Ultraviolet (EUV) spectral range measured using monochromatized synchrotron radiation. This work emphasizes the correlation between structure modelling and the reconstructed optical parameters in a detailed inverse-problem optimization strategy. Complementary X-ray Reflectivity (XRR) measurements are coupled with Markov chain Monte Carlo (MCMC) based Bayesian inferences and quasi-model-independent methods to create a model factoring the sample's oxidation, contamination, and surface roughness. The sensitivity of the modelling scheme is tested and verified against contamination and oxidation. A notable approach mitigating the high dimensionality of the reconstruction problem is elaborated with the results of this work compared to two previously published datasets. The presented dataset is of high interest for the continuing development of Extreme Ultraviolet Lithography (EUVL) and EUV astronomy optical systems.


title: Robust Orthogonal Machine Learning of Treatment Effects

abstract: Causal learning is the key to obtaining stable predictions and answering \textit{what if} problems in decision-makings. In causal learning, it is central to seek methods to estimate the average treatment effect (ATE) from observational data. The Double/Debiased Machine Learning (DML) is one of the prevalent methods to estimate ATE. However, the DML estimators can suffer from an \textit{error-compounding issue} and even give extreme estimates when the propensity scores are close to 0 or 1. Previous studies have overcome this issue through some empirical tricks such as propensity score trimming, yet none of the existing works solves it from a theoretical standpoint. In this paper, we propose a \textit{Robust Causal Learning (RCL)} method to offset the deficiencies of DML estimators. Theoretically, the RCL estimators i) satisfy the (higher-order) orthogonal condition and are as \textit{consistent and doubly robust} as the DML estimators, and ii) get rid of the error-compounding issue. Empirically, the comprehensive experiments show that: i) the RCL estimators give more stable estimations of the causal parameters than DML; ii) the RCL estimators outperform traditional estimators and their variants when applying different machine learning models on both simulation and benchmark datasets, and a mimic consumer credit dataset generated by WGAN.


title: A Federated Learning Framework for Smart Grids: Securing Power Traces in Collaborative Learning

abstract: With the deployment of smart sensors and advancements in communication technologies, big data analytics have become vastly popular in the smart grid domain, informing stakeholders of the best power utilization strategy. However, these power-related data are stored and owned by different parties. For example, power consumption data are stored in numerous transformer stations across cities; mobility data of the population, which are important indicators of power consumption, are held by mobile companies. Direct data sharing might compromise party benefits, individual privacy and even national security. Inspired by the federated learning scheme from Google AI, we propose a federated learning framework for smart grids, which enables collaborative learning of power consumption patterns without leaking individual power traces. Horizontal federated learning is employed when data are scattered in the sample space; vertical federated learning, on the other hand, is designed for the case with data scattered in the feature space. Case studies show that, with proper encryption schemes such as Paillier encryption, the machine learning models constructed from the proposed framework are lossless, privacy-preserving and effective. Finally, the promising future of federated learning in other facets of the smart grid is discussed, including electric vehicles, distributed generation/consumption and integrated energy systems.


title: Reinforcement Learning based on MPC/MHE for Unmodeled and Partially Observable Dynamics

abstract: This paper proposes an observer-based framework for solving Partially Observable Markov Decision Processes (POMDPs) when an accurate model is not available. We first propose to use a Moving Horizon Estimation-Model Predictive Control (MHE-MPC) scheme in order to provide a policy for the POMDP problem, where the full state of the real process is not measured and necessarily known. We propose to parameterize both MPC and MHE formulations, where certain adjustable parameters are regarded for tuning the policy. In this paper, for the sake of tackling the unmodeled and partially observable dynamics, we leverage the Reinforcement Learning (RL) to tune the parameters of MPC and MHE schemes jointly, with the closed-loop performance of the policy as a goal rather than model fitting or the MHE performance. Illustrations show that the proposed approach can effectively increase the performance of close-loop control of systems formulated as POMDPs.


title: Thin-shell theory for rotationally invariant random simplices

abstract: For fixed functions $G,H:[0,\infty)\to[0,\infty)$, consider the rotationally invariant probability density on $\mathbb{R}^n$ of the form \[ \mu^n(ds) = \frac{1}{Z_n} G(\|s\|_2)\, e^{ - n H( \|s\|_2)} ds. \] We show that when $n$ is large, the Euclidean norm $\|Y^n\|_2$ of a random vector $Y^n$ distributed according to $\mu^n$ satisfies a Gaussian thin-shell property: the distribution of $\|Y^n\|_2$ concentrates around a certain value $s_0$, and the fluctuations of $\|Y^n\|_2$ are approximately Gaussian with the order $1/\sqrt{n}$. We apply this thin shell property to the study of rotationally invariant random simplices, simplices whose vertices consist of the origin as well as independent random vectors $Y_1^n,\ldots,Y_p^n$ distributed according to $\mu^n$. We show that the logarithmic volume of the resulting simplex exhibits highly Gaussian behavior, providing a generalizing and unifying setting for the objects considered in Grote-Kabluchko-Th\"ale [Limit theorems for random simplices in high dimensions, ALEA, Lat. Am. J. Probab. Math. Stat. 16, 141--177 (2019)]. Finally, by relating the volumes of random simplices to random determinants, we show that if $A^n$ is an $n \times n$ random matrix whose entries are independent standard Gaussian random variables, then there are explicit constants $c_0,c_1\in(0,\infty)$ and an absolute constant $C\in(0,\infty)$ such that \[\sup_{ s \in \mathbb{R}} \left| \mathbb{P} \left[ \frac{ \log \mathrm{det}(A^n) - \log(n-1)! - c_0 }{ \sqrt{ \frac{1}{2} \log n + c_1 }} < s \right] - \int_{-\infty}^s \frac{e^{ - u^2/2} du}{ \sqrt{ 2 \pi }} \right| < \frac{C}{\log^{3/2}n}, \] sharpening the $1/\log^{1/3 + o(1)}n$ bound in Nguyen and Vu [Random matrices: Law of the determinant, Ann. Probab. 42 (1) (2014), 146--167].


title: Rate-Diverse Gaussian Multiple Access: Efficient Encoder and Decoder Designs

abstract: In this work, we develop a pair of rate-diverse encoder and decoder for a two-user Gaussian multiple access channel (GMAC). The proposed scheme enables the users to transmit with the same codeword length but different coding rates under diverse user channel conditions. First, we propose the row-combining (RC) method and row-extending (RE) method to design practical low-density parity-check (LDPC) channel codes for rate-diverse GMAC. Second, we develop an iterative rate-diverse joint user messages decoding (RDJD) algorithm for GMAC, where all user messages are decoded with a single parity-check matrix. In contrast to the conventional network-coded multiple access (NCMA) and compute-forward multiple access (CFMA) schemes that first recover a linear combination of the transmitted codewords and then decode both user messages, this work can decode both the user messages simultaneously. Extrinsic information transfer (EXIT) chart analysis and simulation results indicate that RDJD can achieve gains up to 1.0 dB over NCMA and CFMA in the two-user GMAC. In particular, we show that there exists an optimal rate allocation for the two users to achieve the best decoding performance given the channel conditions and sum rate.


title: Applications of Game Theory in Vehicular Networks: A Survey

abstract: In the Internet of Things (IoT) era, vehicles and other intelligent components in an intelligent transportation system (ITS) are connected, forming Vehicular Networks (VNs) that provide efficient and secure traffic and ubiquitous access to various applications. However, as the number of nodes in ITS increases, it is challenging to satisfy a varied and large number of service requests with different Quality of Service and security requirements in highly dynamic VNs. Intelligent nodes in VNs can compete or cooperate for limited network resources to achieve either an individual or a group's objectives. Game Theory (GT), a theoretical framework designed for strategic interactions among rational decision-makers sharing scarce resources, can be used to model and analyze individual or group behaviors of communicating entities in VNs. This paper primarily surveys the recent developments of GT in solving various challenges of VNs. This survey starts with an introduction to the background of VNs. A review of GT models studied in the VNs is then introduced, including its basic concepts, classifications, and applicable vehicular issues. After discussing the requirements of VNs and the motivation of using GT, a comprehensive literature review on GT applications in dealing with the challenges of current VNs is provided. Furthermore, recent contributions of GT to VNs integrating with diverse emerging 5G technologies are surveyed. Finally, the lessons learned are given, and several key research challenges and possible solutions for applying GT in VNs are outlined.


title: Effective discreteness radius of stabilisers for stationary actions

abstract: We prove an effective variant of the Kazhdan-Margulis theorem generalized to stationary actions of semisimple groups over local fields: the probability that the stabilizer of a random point admits a non-trivial intersection with a small $r$-neighborhood of the identity is at most $\beta r^\delta$ for some explicit constants $\beta, \delta > 0$ depending only the group. This is a consequence of a key convolution inequality. We deduce that vanishing at infinity of injectivity radius implies finiteness of volume. Further applications are the compactness of the space of discrete stationary random subgroups and a novel proof of the fact that all lattices in semisimple groups are weakly cocompact.


title: On Evaluations of Euler-type Sums of Hyperharmonic Numbers

abstract: We give explicit evaluations of the linear and non-linear Euler sums of hyperharmonic numbers $h_{n}^{\left( r\right) }$ with reciprocal binomial coefficients. These evaluations enable us to extend closed form formula of Euler sums of hyperharmonic numbers to an arbitrary integer $r$. Moreover, we reach at explicit formulas for the shifted Euler-type sums of harmonic and hyperharmonic numbers. All the evaluations are provided in terms of the Riemann zeta values, harmonic numbers and linear Euler sums.


title: K0 and K+ meson electromagnetic form factors: a nonperturbative relativistic quark model versus experimental, perturbative and lattice Quantum-Chromodynamics results

abstract: It has been previously shown that a particular nonperturbative constituent-quark model of hadrons describes experimental measurements of electromagnetic form factors of light charged mesons through a small number of common phenomenological parameters, matching at the same time the Quantum-Chromodynamics (QCD) asymptotics for the pi-meson form factor at large momentum transfer. Here we start with the determination of the K0 electromagnetic form factor in this approach. Precise measurement of the K0 charge radius makes it possible to constrain model parameters with high accuracy. Then, with all parameters fixed, we revisit the K+ form factor and find that it matches experimental measurements in the infrared, lattice results at moderate momentum transfer and the perturbative QCD asymptotics in the ultraviolet. In this way we obtain a narrow constraint on the K+ charge radius, <r_K+^2> = 0.403 +0.007 -0.006 fm^2, and extend the successful infrared-ultraviolet connection from pi to K mesons.


title: BlonDe: An Automatic Evaluation Metric for Document-level Machine Translation

abstract: Standard automatic metrics, e.g. BLEU, are not reliable for document-level MT evaluation. They can neither distinguish document-level improvements in translation quality from sentence-level ones, nor identify the discourse phenomena that cause context-agnostic translations. This paper introduces a novel automatic metric BlonDe to widen the scope of automatic MT evaluation from sentence to document level. BlonDe takes discourse coherence into consideration by categorizing discourse-related spans and calculating the similarity-based F1 measure of categorized spans. We conduct extensive comparisons on a newly constructed dataset BWB. The experimental results show that BlonDe possesses better selectivity and interpretability at the document-level, and is more sensitive to document-level nuances. In a large-scale human study, BlonDe also achieves significantly higher Pearson's r correlation with human judgments compared to previous metrics.


title: Real-time End-to-End Federated Learning: An Automotive Case Study

abstract: With the development and the increasing interests in ML/DL fields, companies are eager to apply Machine Learning/Deep Learning approaches to increase service quality and customer experience. Federated Learning was implemented as an effective model training method for distributing and accelerating time-consuming model training while protecting user data privacy. However, common Federated Learning approaches, on the other hand, use a synchronous protocol to conduct model aggregation, which is inflexible and unable to adapt to rapidly changing environments and heterogeneous hardware settings in real-world scenarios. In this paper, we present an approach to real-time end-to-end Federated Learning combined with a novel asynchronous model aggregation protocol. Our method is validated in an industrial use case in the automotive domain, focusing on steering wheel angle prediction for autonomous driving. Our findings show that asynchronous Federated Learning can significantly improve the prediction performance of local edge models while maintaining the same level of accuracy as centralized machine learning. Furthermore, by using a sliding training window, the approach can minimize communication overhead, accelerate model training speed and consume real-time streaming data, proving high efficiency when deploying ML/DL components to heterogeneous real-world embedded systems.


title: Systematic KMTNet Planetary Anomaly Search, Paper I: OGLE-2019-BLG-1053Lb, A Buried Terrestrial Planet

abstract: In order to exhume the buried signatures of "missing planetary caustics" in the KMTNet data, we conducted a systematic anomaly search to the residuals from point-source point-lens fits, based on a modified version of the KMTNet EventFinder algorithm. This search reveals the lowest mass-ratio planetary caustic to date in the microlensing event OGLE-2019-BLG-1053, for which the planetary signal had not been noticed before. The planetary system has a planet-host mass ratio of $q = (1.25 \pm 0.13) \times 10^{-5}$. A Bayesian analysis yields estimates of the mass of the host star, $M_{\rm host} = 0.61_{-0.24}^{+0.29}~M_\odot$, the mass of its planet, $M_{\rm planet} = 2.48_{-0.98}^{+1.19}~M_{\oplus}$, the projected planet-host separation, $a_\perp = 3.4_{-0.5}^{+0.5}$ au, and the lens distance of $D_{\rm L} = 6.8_{-0.9}^{+0.6}$ kpc. The discovery of this very low mass-ratio planet illustrates the utility of our method and opens a new window for a large and homogeneous sample to study the microlensing planet-host mass-ratio function down to $q \sim 10^{-5}$.


title: Introspective Visuomotor Control: Exploiting Uncertainty in Deep Visuomotor Control for Failure Recovery

abstract: End-to-end visuomotor control is emerging as a compelling solution for robot manipulation tasks. However, imitation learning-based visuomotor control approaches tend to suffer from a common limitation, lacking the ability to recover from an out-of-distribution state caused by compounding errors. In this paper, instead of using tactile feedback or explicitly detecting the failure through vision, we investigate using the uncertainty of a policy neural network. We propose a novel uncertainty-based approach to detect and recover from failure cases. Our hypothesis is that policy uncertainties can implicitly indicate the potential failures in the visuomotor control task and that robot states with minimum uncertainty are more likely to lead to task success. To recover from high uncertainty cases, the robot monitors its uncertainty along a trajectory and explores possible actions in the state-action space to bring itself to a more certain state. Our experiments verify this hypothesis and show a significant improvement on task success rate: 12% in pushing, 15% in pick-and-reach and 22% in pick-and-place.


title: Generating Adversarial Computer Programs using Optimized Obfuscations

abstract: Machine learning (ML) models that learn and predict properties of computer programs are increasingly being adopted and deployed. These models have demonstrated success in applications such as auto-completing code, summarizing large programs, and detecting bugs and malware in programs. In this work, we investigate principled ways to adversarially perturb a computer program to fool such learned models, and thus determine their adversarial robustness. We use program obfuscations, which have conventionally been used to avoid attempts at reverse engineering programs, as adversarial perturbations. These perturbations modify programs in ways that do not alter their functionality but can be crafted to deceive an ML model when making a decision. We provide a general formulation for an adversarial program that allows applying multiple obfuscation transformations to a program in any language. We develop first-order optimization algorithms to efficiently determine two key aspects -- which parts of the program to transform, and what transformations to use. We show that it is important to optimize both these aspects to generate the best adversarially perturbed program. Due to the discrete nature of this problem, we also propose using randomized smoothing to improve the attack loss landscape to ease optimization. We evaluate our work on Python and Java programs on the problem of program summarization. We show that our best attack proposal achieves a $52\%$ improvement over a state-of-the-art attack generation approach for programs trained on a seq2seq model. We further show that our formulation is better at training models that are robust to adversarial attacks.


title: Regularized Softmax Deep Multi-Agent $Q$-Learning

abstract: Tackling overestimation in $Q$-learning is an important problem that has been extensively studied in single-agent reinforcement learning, but has received comparatively little attention in the multi-agent setting. In this work, we empirically demonstrate that QMIX, a popular $Q$-learning algorithm for cooperative multi-agent reinforcement learning (MARL), suffers from a more severe overestimation in practice than previously acknowledged, and is not mitigated by existing approaches. We rectify this with a novel regularization-based update scheme that penalizes large joint action-values that deviate from a baseline and demonstrate its effectiveness in stabilizing learning. Furthermore, we propose to employ a softmax operator, which we efficiently approximate in a novel way in the multi-agent setting, to further reduce the potential overestimation bias. Our approach, Regularized Softmax (RES) Deep Multi-Agent $Q$-Learning, is general and can be applied to any $Q$-learning based MARL algorithm. We demonstrate that, when applied to QMIX, RES avoids severe overestimation and significantly improves performance, yielding state-of-the-art results in a variety of cooperative multi-agent tasks, including the challenging StarCraft II micromanagement benchmarks.


title: Comparative evaluation of point process forecasts

abstract: Stochastic models of point patterns in space and time are widely used to issue forecasts or assess risk, and often they affect societally relevant decisions. We adapt the concept of consistent scoring functions and proper scoring rules, which are statistically principled tools for the comparative evaluation of predictive performance, to the point process setting, and place both new and existing methodology in this framework. With reference to earthquake likelihood model testing, we demonstrate that extant techniques apply in much broader contexts than previously thought. In particular, the Poisson log-likelihood can be used for theoretically principled comparative forecast evaluation in terms of cell expectations. We illustrate the approach in a simulation study and in a comparative evaluation of operational earthquake forecasts for Italy.


title: Direct observation of the layer-number-dependent electronic structure in few-layer WTe2

abstract: When a crystal becomes thinner and thinner to the atomic level, peculiar phenomena discretely depending on its layer-numbers (n) start to appear. The symmetry and wave functions strongly reflect the layer-numbers and stacking order, which brings us a potential of realizing new properties and functions that are unexpected in either bulk or simple monolayer. Multilayer WTe2 is one such example exhibiting unique ferroelectricity and non-linear transport properties related to the antiphase stacking and Berry-curvature dipole. Here we investigate the electronic band dispersions of multilayer WTe2 (2-5 layers), by performing laser-based micro-focused angle-resolved photoelectron spectroscopy on exfoliated-flakes that are strictly sorted by n and encapsulated by graphene. We clearly observed the insulator-semimetal transition occurring between 2- and 3-layers, as well as the 30-70 meV spin-splitting of valence bands manifesting in even n as a signature of stronger structural asymmetry. Our result fully demonstrates the possibility of the large energy-scale band and spin manipulation through the finite n stacking procedure.


title: DeepViT: Towards Deeper Vision Transformer

abstract: Vision transformers (ViTs) have been successfully applied in image classification tasks recently. In this paper, we show that, unlike convolution neural networks (CNNs)that can be improved by stacking more convolutional layers, the performance of ViTs saturate fast when scaled to be deeper. More specifically, we empirically observe that such scaling difficulty is caused by the attention collapse issue: as the transformer goes deeper, the attention maps gradually become similar and even much the same after certain layers. In other words, the feature maps tend to be identical in the top layers of deep ViT models. This fact demonstrates that in deeper layers of ViTs, the self-attention mechanism fails to learn effective concepts for representation learning and hinders the model from getting expected performance gain. Based on above observation, we propose a simple yet effective method, named Re-attention, to re-generate the attention maps to increase their diversity at different layers with negligible computation and memory cost. The pro-posed method makes it feasible to train deeper ViT models with consistent performance improvements via minor modification to existing ViT models. Notably, when training a deep ViT model with 32 transformer blocks, the Top-1 classification accuracy can be improved by 1.6% on ImageNet. Code is publicly available at https://github.com/zhoudaquan/dvit_repo.


title: Deconvolution-and-convolution Networks

abstract: 2D Convolutional neural network (CNN) has arguably become the de facto standard for computer vision tasks. Recent findings, however, suggest that CNN may not be the best option for 1D pattern recognition, especially for datasets with over 1 M training samples, e.g., existing CNN-based methods for 1D signals are highly reliant on human pre-processing. Common practices include utilizing discrete Fourier transform (DFT) to reconstruct 1D signal into 2D array. To add to extant knowledge, in this paper, a novel 1D data processing algorithm is proposed for 1D big data analysis through learning a deep deconvolutional-convolutional network. Rather than resorting to human-based techniques, we employed deconvolution layers to convert 1 D signals into 2D data. On top of the deconvolution model, the data was identified by a 2D CNN. Compared with the existing 1D signal processing algorithms, DCNet boasts the advantages of less human-made inference and higher generalization performance. Our experimental results from a varying number of training patterns (50 K to 11 M) from classification and regression demonstrate the desirability of our new approach.


title: Weakly Supervised Recovery of Semantic Attributes

abstract: We consider the problem of the extraction of semantic attributes, supervised only with classification labels. For example, when learning to classify images of birds into species, we would like to observe the emergence of features that zoologists use to classify birds. To tackle this problem, we propose training a neural network with discrete features in the last layer, which is followed by two heads: a multi-layered perceptron (MLP) and a decision tree. Since decision trees utilize simple binary decision stumps we expect those discrete features to obtain semantic meaning. We present a theoretical analysis as well as a practical method for learning in the intersection of two hypothesis classes. Our results on multiple benchmarks show an improved ability to extract a set of features that are highly correlated with the set of unseen attributes.


title: TeV-scale vector leptoquark from Pati-Salam unification with vectorlike families

abstract: In this paper, we show an explicit way to realize a TeV-scale vector leptoquark from the Pati-Salam (PS) unification with extra vectorlike families. The leptoquark mass is constrained to be heavier than PeV-scale by the measurement of a flavor violating kaon decay, $K_L \to \mu e$, in conventional models. This strong constraint can be avoided by introducing vectorlike families consistently with the quark and lepton masses and CKM and PMNS matrices. The other flavor violating processes are also suppressed. In this model, the vector leptoquark can be sufficiently light to explain the recent $b\to s\mu\mu$ anomaly, while the $b\to c\tau\nu$ anomaly is difficult to be explained due to the strong constraints from the $Z^\prime$ boson and vectorlike quark searches at the LHC. When the $b\to s\mu\mu$ anomaly is explained, we show that $\mathcal{O}({0.2})$ % tuning is required in the fermion matrix, the future experiments in $\mu\to e\gamma$ and $\mu$-$e$ conversions will cover the most available parameter space, and sizable neutral meson mixings, induced by the extra Higgs doublets, are unavoidable.


title: Coexistence of Communications and Cognitive MIMO Radar: Waveform Design and Prototype

abstract: New generation of radar systems will need to coexist with other radio frequency (RF) systems, anticipating their behavior and reacting appropriately to avoid interference. In light of this requirement, this paper designs, implements, and evaluates the performance of phase-only sequences (with constant power) for intelligent spectrum utilization using the custom built cognitive Multiple Input Multiple Output (MIMO) radar prototype. The proposed transmit waveforms avoid the frequency bands occupied by narrowband interferers or communication links, while simultaneously have a small cross-correlation among each other to enable their separability at the MIMO radar receiver. The performance of the optimized set of sequences obtained through solving a non-convex bi-objective optimization problem, is compared with the state-of-the-art counterparts, and its applicability is illustrated by the developed prototype. A realistic Long Term Evolution (LTE) downlink is used for the communications, and the real-time system implementation is validated and evaluated through the throughput calculations for communications and the detection performance measurement for the radar system.