title: Low-Fidelity End-to-End Video Encoder Pre-training for Temporal Action Localization

abstract: Temporal action localization (TAL) is a fundamental yet challenging task in video understanding. Existing TAL methods rely on pre-training a video encoder through action classification supervision. This results in a task discrepancy problem for the video encoder -- trained for action classification, but used for TAL. Intuitively, end-to-end model optimization is a good solution. However, this is not operable for TAL subject to the GPU memory constraints, due to the prohibitive computational cost in processing long untrimmed videos. In this paper, we resolve this challenge by introducing a novel low-fidelity end-to-end (LoFi) video encoder pre-training method. Instead of always using the full training configurations for TAL learning, we propose to reduce the mini-batch composition in terms of temporal, spatial or spatio-temporal resolution so that end-to-end optimization for the video encoder becomes operable under the memory conditions of a mid-range hardware budget. Crucially, this enables the gradient to flow backward through the video encoder from a TAL loss supervision, favourably solving the task discrepancy problem and providing more effective feature representations. Extensive experiments show that the proposed LoFi pre-training approach can significantly enhance the performance of existing TAL methods. Encouragingly, even with a lightweight ResNet18 based video encoder in a single RGB stream, our method surpasses two-stream ResNet50 based alternatives with expensive optical flow, often by a good margin.


title: Family Column Generation: A Principled Stabilized Column Generation Approach

abstract: We tackle the problem of accelerating column generation (CG) approaches to set cover formulations in operations research. At each iteration of CG we generate a dual solution that approximately solves the LP over all columns consisting of a subset of columns in the nascent set. We refer to this linear program (LP) as the Family Restricted Master Problem (FRMP), which provides a tighter bound on the master problem at each iteration of CG, while preserving efficient inference. For example, in the single source capacitated facility location problem (SSCFLP) the family of a column $l$ associated with facility $f$ and customer set $N_l$ contains the set of columns associated with $f$ and the customer set that lies in the power set of $N_l$. The solution to FRMP optimization is attacked with a coordinate ascent method in the dual. The generation of direction of travel corresponds to solving the restricted master problem over columns corresponding to the reduced lowest cost column in each family given specific dual variables based on the incumbent dual, and is easily generated without resolving complex pricing problems. We apply our algorithm to the SSCFLP and demonstrate improved performance over two relevant baselines.


title: KNN, An Underestimated Model for Regional Rainfall Forecasting

abstract: Regional rainfall forecasting is an important issue in hydrology and meteorology. This paper aims to design an integrated tool by applying various machine learning algorithms, especially the state-of-the-art deep learning algorithms including Deep Neural Network, Wide Neural Network, Deep and Wide Neural Network, Reservoir Computing, Long Short Term Memory, Support Vector Machine, K-Nearest Neighbor for forecasting regional precipitations over different catchments in Upstate New York. Through the experimental results and the comparison among machine learning models including classification and regression, we find that KNN is an outstanding model over other models to handle the uncertainty in the precipitation data. The data normalization methods such as ZScore and MinMax are also evaluated and discussed.


title: Lessons Learned Developing an Assembly System for WRS 2020 Assembly Challenge

abstract: The World Robot Summit (WRS) 2020 Assembly Challenge is designed to allow teams to demonstrate how one can build flexible, robust systems for assembly of machined objects. We present our approach to assembly based on integration of machine vision, robust planning and execution using behavior trees and a hierarchy of recovery strategies to ensure robust operation. Our system was selected for the WRS 2020 Assembly Challenge finals based on robust performance in the qualifying rounds. We present the systems approach adopted for the challenge.


title: Should College Dropout Prediction Models Include Protected Attributes?

abstract: Early identification of college dropouts can provide tremendous value for improving student success and institutional effectiveness, and predictive analytics are increasingly used for this purpose. However, ethical concerns have emerged about whether including protected attributes in the prediction models discriminates against underrepresented student groups and exacerbates existing inequities. We examine this issue in the context of a large U.S. research university with both residential and fully online degree-seeking students. Based on comprehensive institutional records for this entire student population across multiple years, we build machine learning models to predict student dropout after one academic year of study, and compare the overall performance and fairness of model predictions with or without four protected attributes (gender, URM, first-generation student, and high financial need). We find that including protected attributes does not impact the overall prediction performance and it only marginally improves algorithmic fairness of predictions. While these findings suggest that including protected attributes is preferred, our analysis also offers guidance on how to evaluate the impact in a local context, where institutional stakeholders seek to leverage predictive analytics to support student success.


title: C*-algebras where every element is a limit of products of positive elements

abstract: We obtain a characterization of the unital C*-algebras with the property that every element is a limit of products of positive elements, thereby answering a question of Murphy and Phillips.


title: Intelligent Reflecting Surfaces at Terahertz Bands: Channel Modeling and Analysis

abstract: An intelligent reflecting surface (IRS) at terahertz (THz) bands is expected to have a massive number of reflecting elements to compensate for the severe propagation losses. However, as the IRS size grows, the conventional far-field assumption starts becoming invalid and the spherical wavefront of the radiated waves should be taken into account. In this work, we consider a spherical wave channel model and pursue a comprehensive study of IRS-aided multiple-input multiple-output (MIMO) in terms of power gain and energy efficiency (EE). Specifically, we first analyze the power gain under beamfocusing and beamforming, and show that the latter is suboptimal even for multiple meters away from the IRS. To this end, we derive an approximate, yet accurate, closed-form expression for the loss in the power gain under beamforming. Building on the derived model, we next show that an IRS can significantly improve the EE of MIMO when it operates in the radiating near-field and performs beamfocusing. Numerical results corroborate our analysis and provide novel insights into the design and performance of IRS-assisted THz communication.


title: A general framework for reversible data hiding in encrypted images by reserving room before encryption

abstract: In this paper a general framework to adopt different predictors for reversible data hiding in the encrypted image is presented. We propose innovative predictors that contribute more significantly than conventional ones results in accomplishing more payload. Reserving room before encryption (RRBE) is designated in the proposed scheme making possible to attain high embedding capacity. In RRBE procedure, pre-processing is allowed before image encryption. In our scheme, pre-processing comprises of three main steps: computing prediction-errors, blocking and labeling of the errors. By blocking, we obviate the need for lossless compression to when content-owner is not enthusiastic. Lossless compression is employed in recent state of the art schemes to improve payload. We surpass prior arts exploiting proper predictors, more efficient labeling procedure and blocking of the prediction-errors.


title: Online Flocking Control of UAVs with Mean-Field Approximation

abstract: This work presents a novel, inference-based approach to the distributed and cooperative flocking control of aerial robot swarms. The proposed method stems from the Unmanned Aerial Vehicle (UAV) dynamics by limiting the latent set to the robots' feasible action space, thus preventing any unattainable control inputs from being produced and leading to smooth flocking behavior. By modeling the inter-agent relationships using a pairwise energy function, we show that interacting robot swarms constitute a Markov Random Field. Our algorithm builds on the Mean-Field Approximation and incorporates the collective behavioral rules: cohesion, separation, and velocity alignment. We follow a distributed control scheme and show that our method can control a swarm of UAVs to a formation and velocity consensus with real-time collision avoidance. We validate the proposed method with physical UAVs and high-fidelity simulation experiments.


title: Searching for continuous phase transitions in 5D SU(2) lattice gauge theory

abstract: We study the phase diagram of 5-dimensional $SU(2)$ Yang-Mills theory on the lattice. We consider two extensions of the fundamental plaquette Wilson action in the search for the continuous phase transition suggested by the $4+\epsilon$ expansion. The extensions correspond to new terms in the action: i) a unit size plaquette in the adjoint representation or ii) a two-unit sided square plaquette in the fundamental representation. We use Monte Carlo to sample the first and second derivative of the entropy near the confinement phase transition, with lattices up to $12^{5}$. While we exclude the presence of a second order phase transition in the parameter space we sampled for model i), our data is not conclusive in some regions of the parameter space of model ii).


title: Optimal control of nonconvex integro-differential sweeping processes

abstract: This paper is devoted to the study, for the first time in the literature, of optimal control problems for sweeping processes governed by integro-differential inclusions of the Volterra type with different classes of control functions acting in nonconvex moving sets, external dynamic perturbations, and integral parts of the sweeping dynamics. We establish the existence of optimal solutions and then obtain necessary optimality conditions for a broad class of local minimizers in such problems. Our approach to deriving necessary optimality conditions is based on the method of discrete approximations married to basic constructions and calculus rules of first-order and second-order variational analysis and generalized differentiation. The obtained necessary optimality conditions are expressed entirely in terms of the problem data and are illustrated by nontrivial examples that include applications to optimal control models of non-regular electrical circuits.


title: Rethinking ResNets: Improved Stacking Strategies With High Order Schemes

abstract: Various deep neural network architectures (DNNs) maintain massive vital records in computer vision. While drawing attention worldwide, the design of the overall structure lacks general guidance. Based on the relationship between DNN design and numerical differential equations, we performed a fair comparison of the residual design with higher-order perspectives. We show that the widely used DNN design strategy, constantly stacking a small design (usually 2-3 layers), could be easily improved, supported by solid theoretical knowledge and with no extra parameters needed. We reorganise the residual design in higher-order ways, which is inspired by the observation that many effective networks can be interpreted as different numerical discretisations of differential equations. The design of ResNet follows a relatively simple scheme, which is Euler forward; however, the situation becomes complicated rapidly while stacking. We suppose that stacked ResNet is somehow equalled to a higher-order scheme; then, the current method of forwarding propagation might be relatively weak compared with a typical high-order method such as Runge-Kutta. We propose HO-ResNet to verify the hypothesis of widely used CV benchmarks with sufficient experiments. Stable and noticeable increases in performance are observed, and convergence and robustness are also improved. Our stacking strategy improved ResNet-30 by 2.15 per cent and ResNet-58 by 2.35 per cent on CIFAR-10, with the same settings and parameters. The proposed strategy is fundamental and theoretical and can therefore be applied to any network as a general guideline.


title: Game Theory Based Privacy Preserving Approach for Collaborative Deep Learning in IoT

abstract: The exponential growth of Internet of Things (IoT) has become a transcending force in creating innovative smart devices and connected domains including smart homes, healthcare, transportation and manufacturing. With billions of IoT devices, there is a huge amount of data continuously being generated, transmitted, and stored at various points in the IoT architecture. Deep learning is widely being used in IoT applications to extract useful insights from IoT data. However, IoT users have security and privacy concerns and prefer not to share their personal data with third party applications or stakeholders. In order to address user privacy concerns, Collaborative Deep Learning (CDL) has been largely employed in data-driven applications which enables multiple IoT devices to train their models locally on edge gateways. In this chapter, we first discuss different types of deep learning approaches and how these approaches can be employed in the IoT domain. We present a privacy-preserving collaborative deep learning approach for IoT devices which can achieve benefits from other devices in the system. This learning approach is analyzed from the behavioral perspective of mobile edge devices using a game-theoretic model. We analyze the Nash Equilibrium in N-player static game model. We further present a novel fair collaboration strategy among edge IoT devices using cluster based approach to solve the CDL game, which enforces mobile edge devices for cooperation. We also present implementation details and evaluation analysis in a real-world smart home deployment.


title: On Arroyo-Figueroa's Proof that $\mathrm{P} \neq \mathrm{NP}$

abstract: We critique Javier Arroyo-Figueroa's paper titled ``The existence of the Tau one-way functions class as a proof that $\mathrm{P} \neq \mathrm{NP}$,'' which claims to prove $\mathrm{P} \neq \mathrm{NP}$ by showing the existence of a class of one-way functions. We summarize our best interpretation of Arroyo-Figueroa's argument, and show why it fails to prove the existence of one-way functions. Hence, we show that Arroyo-Figueroa fails to prove $\mathrm{P} \neq \mathrm{NP}$.


title: Combinatorics of vertex operators and deformed $W$-algebra of type D$(2,1;\alpha)$

abstract: We consider sets of screening operators with fermionic screening currents. We study sums of vertex operators which formally commute with the screening operators assuming that each vertex operator has rational contractions with all screening currents with only simple poles. We develop and use the method of $qq$-characters which are combinatorial objects described in terms of deformed Cartan matrix. We show that each qq-character gives rise to a sum of vertex operators commuting with screening operators and describe ways to understand the sum in the case it is infinite. We discuss combinatorics of the qq-characters and their relation to the q-characters of representations of quantum groups. We provide a number of explicit examples of the qq-characters with the emphasis on the case of $D(2,1;\alpha)$. We describe a relationship of the examples to various integrals of motion.


title: Conformal quantum mechanics as a Floquet-Dirac system

abstract: Conformal quantum mechanics has been proposed to be the CFT$_1$ dual to AdS$_2$. The $N$-point correlation function that satisfy conformal constraints have been constructed from a non-conformal vacuum and the insertion of a non-primary operator. The main goal of this paper is to find an interpretation of this oddness. For this purpouse, we study possible gravitational dual models and propose a two-dimensional dilaton gravity with a massless fermion for the description of conformal quantum mechanics. We find a universal correspondence between states in the conformal quantum mechanics model and two-dimensional spacetimes. Moreover, the solutions of the Dirac equation can be interpreted as zero modes of a Floquet-Dirac system. Within this system, the oddness of the non-conformal vacuum and non-primary operator is elucidated. As a possible application, we interpret the gauge symmetries of the Floquet-Dirac system as the corresponding infinite symmetries of the Schr\"odinger equation which are conjectured to be related to higher spin symmetries.


title: Phase transition in noisy high-dimensional random geometric graphs

abstract: We study the problem of detecting latent geometric structure in random graphs. To this end, we consider the soft high-dimensional random geometric graph $\mathcal{G}(n,p,d,q)$, where each of the $n$ vertices corresponds to an independent random point distributed uniformly on the sphere $\mathbb{S}^{d-1}$, and the probability that two vertices are connected by an edge is a decreasing function of the Euclidean distance between the points. The probability of connection is parametrized by $q \in [0,1]$, with smaller $q$ corresponding to weaker dependence on the geometry; this can also be interpreted as the level of noise in the geometric graph. In particular, the model smoothly interpolates between the spherical hard random geometric graph $\mathcal{G}(n,p,d)$ (corresponding to $q = 1$) and the Erd\H{o}s-R\'enyi model $\mathcal{G}(n,p)$ (corresponding to $q = 0$). We focus on the dense regime (i.e., $p$ is a constant). We show that if $nq \to 0$ or $d \gg n^{3} q^{2}$, then geometry is lost: $\mathcal{G}(n,p,d,q)$ is asymptotically indistinguishable from $\mathcal{G}(n,p)$. On the other hand, if $d \ll n^{3} q^{6}$, then the signed triangle statistic provides an asymptotically powerful test for detecting geometry. These results generalize those of Bubeck, Ding, Eldan, and R\'acz (2016) for $\mathcal{G}(n,p,d)$, and give quantitative bounds on how the noise level affects the dimension threshold for losing geometry. We also prove analogous results under a related but different distributional assumption, and we further explore generalizations of signed triangles in order to understand the intermediate regime left open by our results.

categories: math.PR cs.IT cs.SI math.IT math.ST stat.TH


title: ABOME: A Multi-platform Data Repository of Artificially Boosted Online Media Entities

abstract: The rise of online media has incentivized users to adopt various unethical and artificial ways of gaining social growth to boost their credibility within a short time period. In this paper, we introduce ABOME, a novel multi-platform data repository consisting of artificially boosted (also known as blackmarket-driven collusive entities) online media entities such as Twitter tweets/users and YouTube videos/channels, which are prevalent but often unnoticed in online media. ABOME allows quick querying of collusive entities across platforms. These include details of collusive entities involved in blackmarket services to gain artificially boosted appraisals in the form of likes, retweets, views, comments, follows and subscriptions. ABOME contains data related to tweets and users on Twitter, YouTube videos and YouTube channels. We believe that ABOME is a unique data repository that can be used as a benchmark to identify and analyze blackmarket-driven fraudulent activities in online media. We also develop SearchBM, an API and a web portal that offers a free service to identify blackmarket entities.


title: Nonlinearly dispersive KP equations with new compacton solutions

abstract: A complete classification of compacton solutions is carried out for a generalization of the Kadomtsev-Petviashvili (KP) equation involving nonlinear dispersion in two and higher spatial dimensions. In particular, precise conditions are given on the nonlinearity powers in this equation under which a travelling wave can be cut off to obtain a compacton. Numerous explicit examples having various profiles are derived, including a quadratic function, powers of a cosine, and powers of Jacobi $\cn$ functions, all of which are symmetric. The cosine and $\cn$ symmetric compactons have an anti-symmetric counterpart. In comparison, explicit solitary waves of the generalized KP equation are found to have profiles given by a power of a sech and a reciprocal quadratic function. Kinematic properties of all of the different types of compactons and solitary waves are discussed, along with conservation laws of the generalized KP equation.


title: Statistical Inference of Auto-correlated Eigenvalues with Applications to Diffusion Tensor Imaging

abstract: Diffusion tensor imaging (DTI) is a prevalent neuroimaging tool in analyzing the anatomical structure. The distinguishing feature of DTI is that the voxel-wise variable is a 3x3 positive definite matrix other than a scalar, describing the diffusion process at the voxel. Recently, several statistical methods have been proposed to analyze the DTI data. This paper focuses on the statistical inference of eigenvalues of DTI because it provides more transparent clinical interpretations. However, the statistical inference of eigenvalues is statistically challenging because few treat these responses as random eigenvalues. In our paper, we rely on the distribution of the Wishart matrix's eigenvalues to model the random eigenvalues. A hierarchical model which captures the eigenvalues' randomness and spatial auto-correlation is proposed to infer the local covariate effects. The Monte-Carlo Expectation-Maximization algorithm is implemented for parameter estimation. Both simulation studies and application to IXI data-set are used to demonstrate our proposal. The results show that our proposal is more proper in analyzing auto-correlated random eigenvalues compared to alternatives.


title: On the scramble number of graphs

abstract: The scramble number of a graph is an invariant recently developed to aid in the study of divisorial gonality. In this paper we prove that scramble number is NP-hard to compute, also providing a proof that computing gonality is NP-hard even for simple graphs, as well as for metric graphs. We also provide general lower bounds for the scramble number of a Cartesian product of graphs, and apply these to compute gonality for many new families of product graphs.


title: Bayesian Deep Basis Fitting for Depth Completion with Uncertainty

abstract: In this work we investigate the problem of uncertainty estimation for image-guided depth completion. We extend Deep Basis Fitting (DBF) for depth completion within a Bayesian evidence framework to provide calibrated per-pixel variance. The DBF approach frames the depth completion problem in terms of a network that produces a set of low-dimensional depth bases and a differentiable least squares fitting module that computes the basis weights using the sparse depths. By adopting a Bayesian treatment, our Bayesian Deep Basis Fitting (BDBF) approach is able to 1) predict high-quality uncertainty estimates and 2) enable depth completion with few or no sparse measurements. We conduct controlled experiments to compare BDBF against commonly used techniques for uncertainty estimation under various scenarios. Results show that our method produces better uncertainty estimates with accurate depth prediction.


title: A More Fine-Grained Aspect-Sentiment-Opinion Triplet Extraction Task

abstract: Aspect Sentiment Triplet Extraction (ASTE) aims to extract aspect term, sentiment and opinion term triplets from sentences and tries to provide a complete solution for aspect-based sentiment analysis (ABSA). However, some triplets extracted by ASTE are confusing, since the sentiment in a triplet extracted by ASTE is the sentiment that the sentence expresses toward the aspect term rather than the sentiment of the aspect term and opinion term pair. In this paper, we introduce a more fine-grained Aspect-Sentiment-Opinion Triplet Extraction (ASOTE) Task. ASOTE also extracts aspect term, sentiment and opinion term triplets. However, the sentiment in a triplet extracted by ASOTE is the sentiment of the aspect term and opinion term pair. We build four datasets for ASOTE based on several popular ABSA benchmarks. We propose a Position-aware BERT-based Framework (PBF) to address this task. PBF first extracts aspect terms from sentences. For each extracted aspect term, PBF first generates aspect term-specific sentence representations considering both the meaning and the position of the aspect term, then extracts associated opinion terms and predicts the sentiments of the aspect term and opinion term pairs based on the sentence representations. Experimental results on the four datasets show the effectiveness of PBF.


title: Personalized Affect-Aware Socially Assistive Robot Tutors Aimed at Fostering Social Grit in Children with Autism

abstract: Affect-aware socially assistive robotics (SAR) tutors have great potential to augment and democratize professional therapeutic interventions for children with autism spectrum disorders (ASD) from different socioeconomic backgrounds. However, the majority of research on SAR for ASD has been on teaching cognitive and/or social skills, not on addressing users' emotional needs for real-world social situations. To bridge that gap, this work aims to develop personalized affect-aware SAR tutors to help alleviate social anxiety and foster social grit-the growth mindset for social skill development-in children with ASD. We propose a novel paradigm to incorporate clinically validated Acceptance and Commitment Training (ACT) with personalized SAR interventions. This work paves the way toward developing personalized affect-aware SAR interventions to support the unique and diverse socio-emotional needs and challenges of children with ASD.


title: A strong Schottky lemma on $n$ generators for $\mathrm{CAT}(0)$ spaces

abstract: We give a criterion for a set of $n$ hyperbolic isometries of a $\mathrm{CAT}(0)$ metric space $X$ to generate a free group on $n$ generators. This extends a result by Alperin, Farb and Noskov who proved this for 2 generators under the additional assumption that $X$ is complete and has no fake zero angles. Moreover, when $X$ is locally compact, the group we obtain is also discrete.


title: Real-Time Feedback Control of Charge Sensing for Quantum Dot Qubits

abstract: Measurement of charge configurations in few-electron quantum dots is a vital technique for spin-based quantum information processing. While fast and high-fidelity measurement is possible by using proximal quantum dot charge sensors, their operating range is limited and prone to electrical disturbances. Here we demonstrate realtime operation of a charge sensor in a feedback loop to maintain its sensitivity suitable for fast charge sensing in a Si/SiGe double quantum dot. Disturbances to the charge sensitivity, due to variation of gate voltages for operating the quantum dot and $1/f$ charge fluctuation, are compensated by a digital PID controller with the bandwidth of $\approx 100\,{\rm kHz}$. The rapid automated tuning of a charge sensor enables unobstructed charge stability diagram measurement facilitating realtime quantum dot tuning and submicrosecond single-shot spin readout without compromising the performance of a charge sensor in time-consuming experiments for quantum information processing.


title: Regularity estimates for the p-Sobolev flow

abstract: We study doubly nonlinear parabolic equation arising from the gradient flow for p-Sobolev type inequality, referred as p-Sobolev flow from now on, which includes the classical Yamabe flow on a bounded domain in Euclidean space in the special case p=2. In this article we establish a priori estimates and regularity results for the $p$-Sobolev type flow, which are necessary for further analysis and classification of limits as time tends to infinity.


title: Deep reinforcement learning of event-triggered communication and control for multi-agent cooperative transport

abstract: In this paper, we explore a multi-agent reinforcement learning approach to address the design problem of communication and control strategies for multi-agent cooperative transport. Typical end-to-end deep neural network policies may be insufficient for covering communication and control; these methods cannot decide the timing of communication and can only work with fixed-rate communications. Therefore, our framework exploits event-triggered architecture, namely, a feedback controller that computes the communication input and a triggering mechanism that determines when the input has to be updated again. Such event-triggered control policies are efficiently optimized using a multi-agent deep deterministic policy gradient. We confirmed that our approach could balance the transport performance and communication savings through numerical simulations.


title: One Network Fits All? Modular versus Monolithic Task Formulations in Neural Networks

abstract: Can deep learning solve multiple tasks simultaneously, even when they are unrelated and very different? We investigate how the representations of the underlying tasks affect the ability of a single neural network to learn them jointly. We present theoretical and empirical findings that a single neural network is capable of simultaneously learning multiple tasks from a combined data set, for a variety of methods for representing tasks -- for example, when the distinct tasks are encoded by well-separated clusters or decision trees over certain task-code attributes. More concretely, we present a novel analysis that shows that families of simple programming-like constructs for the codes encoding the tasks are learnable by two-layer neural networks with standard training. We study more generally how the complexity of learning such combined tasks grows with the complexity of the task codes; we find that combining many tasks may incur a sample complexity penalty, even though the individual tasks are easy to learn. We provide empirical support for the usefulness of the learning bounds by training networks on clusters, decision trees, and SQL-style aggregation.


title: Divides with cusps and Kirby diagrams for line arrangements

abstract: The complement of a complexified real line arrangement is an affine surface. It is classically known that such a space has a handle decomposition up to $2$-handles. We will describe the handle decomposition induced from Lefschetz hyperplane section theorem for such a space. To describe the Kirby diagram, we introduce the notion of the divide with cusps which is a generalization of the divide introduced by A'Campo.


title: Zero-shot Adversarial Quantization

abstract: Model quantization is a promising approach to compress deep neural networks and accelerate inference, making it possible to be deployed on mobile and edge devices. To retain the high performance of full-precision models, most existing quantization methods focus on fine-tuning quantized model by assuming training datasets are accessible. However, this assumption sometimes is not satisfied in real situations due to data privacy and security issues, thereby making these quantization methods not applicable. To achieve zero-short model quantization without accessing training data, a tiny number of quantization methods adopt either post-training quantization or batch normalization statistics-guided data generation for fine-tuning. However, both of them inevitably suffer from low performance, since the former is a little too empirical and lacks training support for ultra-low precision quantization, while the latter could not fully restore the peculiarities of original data and is often low efficient for diverse data generation. To address the above issues, we propose a zero-shot adversarial quantization (ZAQ) framework, facilitating effective discrepancy estimation and knowledge transfer from a full-precision model to its quantized model. This is achieved by a novel two-level discrepancy modeling to drive a generator to synthesize informative and diverse data examples to optimize the quantized model in an adversarial learning fashion. We conduct extensive experiments on three fundamental vision tasks, demonstrating the superiority of ZAQ over the strong zero-shot baselines and validating the effectiveness of its main components. Code is available at <https://git.io/Jqc0y>.


title: Hosotani mechanism in the "color"-singlet plasma

abstract: By projecting the partition function on the "color"-singlet state, we investigate the Hosotani mechanism in the fermion-gauge boson plasma. The present toy-model analysis of the one-loop effective potential at finite temperature shows that the critical temperature of gauge symmetry breaking increases at higher temperature in the smaller volume.


title: Polychrony as Chinampas

abstract: In this paper, we study the flow of signals through linear paths with the nonlinear condition that a node emits a signal when it receives external stimuli or when two incoming signals from other nodes arrive coincidentally with a combined amplitude above a fixed threshold. Sets of such nodes form a polychrony group and can sometimes lead to cascades. In the context of this work, cascades are polychrony groups in which the number of nodes activated as a consequence of other nodes is greater than the number of externally activated nodes. The difference between these two numbers is the so-called profit. Given the initial conditions, we predict the conditions for a vertex to activate at a prescribed time and provide an algorithm to efficiently reconstruct a cascade. We develop a dictionary between polychrony groups and graph theory. We call the graph corresponding to a cascade a chinampa. This link leads to a topological classification of chinampas. We enumerate the chinampas of profits zero and one and the description of a family of chinampas isomorphic to a family of partially ordered sets, which implies that the enumeration problem of this family is equivalent to computing the Stanley-order polynomials of those partially ordered sets.


title: Theta, alpha and gamma traveling waves in a multi-item working memory model

abstract: Brain oscillations are believed to be involved in the different operations necessary to manipulate information during working memory tasks. We propose a modular variant of the Lisman-Idiart model for short-term memory, where theta, alpha and gamma oscillations are traveling waves. Using this model we show that the interactions between theta and gamma determine the allocation of multiple information in distinct modules, while the interference between theta and alpha disrupts the maintenance of current stored information. The effect of alpha in erasing or blocking storage is robust and seems fairly independent of the frequency, as long as it stays within the alpha range. The model help us to understand why the alpha and theta oscillations, which have close frequency bands, could have opposite roles in working memory.


title: Fast neutrino flavor instability and neutrino flavor lepton number crossings

abstract: In this paper, we show the equivalency between the existence of fast neutrino flavor instability and that of neutrino flavor lepton number (NFLN) crossings, which indicates that an NFLN angular distribution takes both signs. The veracity of this proposition has been uncertain and sometimes controversial despite its indispensability in the flavor evolutions of dense neutrinos. This study clarifies that the occurrence of an NFLN crossing is both necessary and sufficient for fast instability.


title: Real World Scrum A Grounded Theory of Variations in Practice

abstract: Scrum, the most popular agile method and project management framework, is widely reported to be used, adapted, misused, and abused in practice. However, not much is known about how Scrum actually works in practice, and critically, where, when, how and why it diverges from Scrum by the book. Through a Grounded Theory study involving semi-structured interviews of 45 participants from 30 companies and observations of five teams, we present our findings on how Scrum works in practice as compared to how it is presented in its formative books. We identify significant variations in these practices such as work breakdown, estimation, prioritization, assignment, the associated roles and artefacts, and discuss the underlying rationales driving the variations. Critically, we claim that not all variations are process misuse/abuse and propose a nuanced classification approach to understanding variations as standard, necessary, contextual, and clear deviations for successful Scrum use and adaptation


title: A novel approach to investigate chemical inhomogeneities in GRB host galaxies: The $Z_{\rm abs} - Z_{\rm emiss}$ relation

abstract: Models of chemical enrichment and inhomogeneity in high-redshift galaxies are challenging to constrain observationally. In this work, we discuss a novel approach to probe chemical inhomogeneities within long Gamma-Ray Burst (GRB) host galaxies, by comparing the absorption metallicity, Z_abs, from the GRB afterglow (which probes the environment along the line of sight) with the emission-line metallicity, Z_emiss, measured via slit spectroscopy. Using the IllustrisTNG simulation, the theoretical relationship between these metallicity metrics is explored for a range of GRB formation models, varying the GRB progenitor metallicity threshold. For galaxies with fixed Z_emiss, the median value of Z_abs depends strongly on the GRB progenitor threshold metallicity, with Z_abs significantly lower than Z_emiss for high metallicity hosts. Conversely, at fixed Z_abs, the median value of Z_emiss depends primarily on the metallicity distribution of galaxies in IllustrisTNG and their chemical inhomogeneities, offering a GRB-model-independent way to constrain these processes observationally. Currently, only one host galaxy has data for both absorption and emission metallicities (GRB121014A). We re-analyse the emission spectrum and compare the inferred metallicity Z_emiss to a recent Bayesian determination of Z_abs, finding $\log(Z_{\rm emiss}/Z_{\odot}) = \log(Z_{\rm abs}/Z_{\odot}) +0.35^{+ 0.14}_{- 0.25}$, within ~2 standard deviations of predictions from the IllustrisTNG simulation. Future observations with the James Webb Space Telescope will be able to measure Z_emiss for 4 other GRB hosts with known Z_abs values, using ~2 hour observations. While small, the sample will provide preliminary constraints on the Z_abs-Z_emiss relation to test chemical enrichment schemes in cosmological simulations.


title: A Unifying Framework of Accelerated First-Order Approach to Strongly Monotone Variational Inequalities

abstract: In this paper, we propose a unifying framework incorporating several momentum-related search directions for solving strongly monotone variational inequalities. The specific combinations of the search directions in the framework are made to guarantee the optimal iteration complexity bound of $\mathcal{O}\left(\kappa\ln(1/\epsilon)\right)$ to reach an $\epsilon$-solution, where $\kappa$ is the condition number. This framework provides the flexibility for algorithm designers to train -- among different parameter combinations -- the one that best suits the structure of the problem class at hand. The proposed framework includes the following iterative points and directions as its constituents: the extra-gradient, the optimistic gradient descent ascent (OGDA) direction (aka "optimism"), the "heavy-ball" direction, and Nesterov's extrapolation points. As a result, all the afore-mentioned methods become the special cases under the general scheme of extra points. We also specialize this approach to strongly convex minimization, and show that a similar extra-point approach achieves the optimal iteration complexity bound of $\mathcal{O}(\sqrt{\kappa}\ln(1/\epsilon))$ for this class of problems.


title: A Note on Global Optimization for Max-Plus Linear Systems

abstract: This note further addresses the global optimization problem for max-plus linear systems considered in [Automatica 119 (2020) 109104]. Firstly, the operations between infinity elemens and real numbers involved in the formulas of solving global optimization problems are explained explicitly. Secondly, the formula of the greatest lower bound and the criterion of solvability of globally optimal solutions are simplified. Thirdly, the criterion of uniqueness of globally optimal solutions and the set of all globally optimal solutions are presented.


title: Holographic photonic neuron

abstract: The promise of artificial intelligence (AI) to process complex datasets has brought about innovative computing paradigms. While recent developments in quantum-photonic computing have reached significant feats, mimicking our brain's ability to recognize images are poorly integrated in these ventures. Here, I incorporate orbital angular momentum (OAM) states in a classical Vander Lugt optical correlator to create the holographic photonic neuron. The photonic neuron can memorize an array of matched filters in a phase-hologram, which is derived by linking OAM states with elements in the array. Successful correlation is independent of intensity and yields photons with OAM states, which can be used as a transmission protocol or qudits for quantum computing. The unique OAM identifier establishes the photonic neuron as a fundamental AI device for pattern recognition that can be scaled and integrated with other computing platforms to build-up a neuromorphic quantum-photonic processor that mimics the brain.


title: Building up the spectrum of pentaquark states as hadronic molecules

abstract: I give a brief comment on the LHCb's discovery of $P_c$ and $P_{cs}$ pentaquark states. These pentaquark states not only reveal a new kind of hadronic molecules, but also shed new light on the possible structure of pentaquark components in baryons, hence may play very important role for understanding un-quenching dynamics and the whole baryon spectroscopy.


title: Quantum phase transitions of interacting bosons on hyperbolic lattices

abstract: The effect of many-body interaction in curved space is studied based on the extended Bose--Hubbard model on hyperbolic lattices. Using the mean-field approximation and quantum Monte Carlo simulation, the phase diagram is explicitly mapped out, which contains the superfluid, supersolid and insulator phases at various fillings. Particularly, it is revealed that the sizes of the Mott lobes shrink and the supersolid is stabilized at smaller nearest-neighbor interaction as $q$ in the Schl\"afli symbol increases. The underlying physical mechanism is attributed to the increase of the coordination number, and hence the kinetic energy and the nearest-neighbor interaction. The results suggest that the hyperbolic lattices may be a unique platform to study the effect of the coordination number on quantum phase transitions, which may be relevant to the experiments of ultracold atoms in optical lattices.


title: On Anderson acceleration for partially observable Markov decision processes

abstract: This paper proposes an accelerated method for approximately solving partially observable Markov decision process (POMDP) problems offline. Our method carefully combines two existing tools: Anderson acceleration (AA) and the fast informed bound (FIB) method. Adopting AA, our method rapidly solves an approximate Bellman equation with an efficient combination of previous solution estimates. Furthermore, the use of FIB alleviates the scalability issue inherent in POMDPs. We show the convergence of the overall algorithm to the suboptimal solution obtained by FIB. We further consider a simulation-based method and prove that the approximation error is bounded explicitly. The performance of our algorithm is evaluated on several benchmark problems. The results of our experiments demonstrate that the proposed algorithm converges significantly faster without degrading the quality of the solution compared to its standard counterpart.


title: Stability of solutions to abstract evolution equations in Banach spaces under nonclassical assumptions

abstract: The stability of the solution to the equation $(*)\dot{u} = F(t,u)+f(t)$, $t\ge 0$, $u(0)=u_0$ is studied. Here $F(t,u)$ is a nonlinear operator in a Banach space $\mathcal{X}$ for any fixed $t\ge 0$ and $F(t,0)=0$, $\forall t\ge 0$. We assume that the Fr\'echet derivative of $F(t,u)$ is H\"{o}lder continuous of order $q>0$ with respect to $u$ for any fixed $t\ge 0$, i.e., $\|F'_u(t,w) - F'_u(t,v)\|\le \alpha(t)\|v - w\|^{q}$, $q>0$. We proved that the equilibrium solution $v=0$ to the equation $\dot{v} = F(t,v)$ is Lyapunov stable under persistently acting perturbation $f(t)$ if $\sup_{t\ge 0}\int_0^t \alpha(\xi)\|U(t,\xi)\|\, d\xi<\infty$ and $\sup_{t\ge 0}\|U(t)\|<\infty$. Here, $U(t):=U(t,0)$ and $U(t,\xi)$ is the solution to the equation $\frac{d}{dt}{U}(t,\xi) = F'_u(t,0)U(t,\xi)$, $t\ge \xi$, $U(\xi,\xi)=I$, where $I$ is the identity operator in $\mathcal{X}$. Sufficient conditions for the solution $u(t)$ to equation (*) to be bounded and for $\lim_{t\to\infty}u(t) = 0$ are proposed and justified. Stability of solutions to equations with unbounded operators in Hilbert spaces is also studied.


title: Applications of the Casson-Walker invariant to the knot complement and the cosmetic crossing conjectures

abstract: We give a rational surgery formula for the Casson-Walker invariant of a 2-component link in $S^{3}$ which is a generalization of Matveev-Polyak's formula. As application, we give more examples of non-hyperbolic L-space $M$ such that knots in $M$ are determined by their complements. We also apply the result for the cosmetic crossing conjecture.


title: The existence of the K\"ahler-Ricci soliton degeneration

abstract: We prove an algebraic version of the Hamilton-Tian Conjecture for all log Fano pairs. More precisely, we show that any log Fano pair admits a canonical two-step degeneration to a reduced uniformly Ding stable triple, which admits a K\"ahler-Ricci soliton when the ground field $\mathbb{k}=\mathbb{C}$.


title: Generalizing to the Open World: Deep Visual Odometry with Online Adaptation

abstract: Despite learning-based visual odometry (VO) has shown impressive results in recent years, the pretrained networks may easily collapse in unseen environments. The large domain gap between training and testing data makes them difficult to generalize to new scenes. In this paper, we propose an online adaptation framework for deep VO with the assistance of scene-agnostic geometric computations and Bayesian inference. In contrast to learning-based pose estimation, our method solves pose from optical flow and depth while the single-view depth estimation is continuously improved with new observations by online learned uncertainties. Meanwhile, an online learned photometric uncertainty is used for further depth and pose optimization by a differentiable Gauss-Newton layer. Our method enables fast adaptation of deep VO networks to unseen environments in a self-supervised manner. Extensive experiments including Cityscapes to KITTI and outdoor KITTI to indoor TUM demonstrate that our method achieves state-of-the-art generalization ability among self-supervised VO methods.


title: In-situ dielectric Al2O3/\b{eta}-Ga2O3 Interfaces Grown Using Metal-organic Chemical Vapor Deposition

abstract: High-quality dielectric-semiconductor interfaces are critical for reliable high-performance transistors. We report the in-situ metalorganic chemical vapor deposition (MOCVD) of Al$_2$O$_3$ on $\beta$-Ga$_2$O$_3$ as a potentially better alternative to the most commonly used atomic layer deposition (ALD). The growth of Al$_2$O$_3$ is performed in the same reactor as Ga$_2$O$_3$ using trimethylaluminum and O$_2$ as precursors without breaking the vacuum at a growth temperature of 600 $^0$C. The fast and slow near interface traps at the Al$_2$O$_3$/ $\beta$-Ga$_2$O$_3$ interface are identified and quantified using stressed capacitance-voltage (CV) measurements on metal oxide semiconductor capacitor (MOSCAP) structures. The density of shallow and deep level initially filled traps (D$_{it}$) are measured using ultra-violet (UV) assisted CV technique. The average D$_{it}$ for the MOSCAP is determined to be 7.8 $\times$ 10$^{11}$ cm$^{-2}$eV$^{-1}$. The conduction band offset of the Al$_2$O$_3$/ Ga$_2$O$_3$ interface is also determined from CV measurements and found out to be 1.7 eV which is in close agreement with the existing literature reports of ALD Al$_2$O$_3$/ Ga$_2$O$_3$ interface. The current-voltage characteristics are also analyzed and the average breakdown field is extracted to be approximately 5.8 MV/cm. This in-situ Al$_2$O$_3$ dielectric on $\beta$-Ga$_2$O$_3$ with improved dielectric properties can enable Ga$_2$O$_3$-based high performance devices.


title: Comment on "Statistical Modeling: The Two Cultures" by Leo Breiman

abstract: Motivated by Breiman's rousing 2001 paper on the "two cultures" in statistics, we consider the role that different modeling approaches play in causal inference. We discuss the relationship between model complexity and causal (mis)interpretation, the relative merits of plug-in versus targeted estimation, issues that arise in tuning flexible estimators of causal effects, and some outstanding cultural divisions in causal inference.


title: Search for exotic spin-dependent interactions with a spin-based amplifier

abstract: Development of new techniques to search for particles beyond the standard model is crucial for understanding the ultraviolet completion of particle physics. Several hypothetical particles are predicted to mediate exotic spin-dependent interactions between particles of the standard model that may be accessible to laboratory experiments. However, laboratory searches are mostly conducted for static spin-dependent interactions, with only a few experiments so far addressing spin- and velocity-dependent interactions. Here, we demonstrate a search for exotic spin- and velocity-dependent interactions with a spin-based amplifier. Our technique makes use of hyperpolarized nuclear spins as a pre-amplifier to enhance the effect of pseudo-magnetic field produced by exotic interactions by an amplification factor of > 100. Using such a spin-based amplifier, we establish constraints on the spin- and velocity-dependent interactions between polarized and unpolarized nucleons in the force range of 0.03-100 m. Our limits represent at least two orders of magnitude improvement compared to previous experiments. The established technique can be further extended to investigate other exotic spin-dependent interactions.


title: On the survival of the quantum depletion of a condensate after release from a magnetic trap

abstract: We present observations of the high momentum tail in expanding Bose-Einstein condensates of metastable Helium atoms released from a harmonic trap. The far-field density profile exhibits features that support identification of the tails of the momentum distribution as originating in the in-situ quantum depletion prior to release. Thus, we corroborate recent observations of slowly-decaying tails in the far-field beyond the thermal component. This observation is in conflict with the hydrodynamic theory, which predicts that the in-situ depletion does not survive when atoms are released from a trap. Indeed, the depleted tails even appear stronger in the far-field than expected before release, and we discuss the challenges of interpreting this in terms of the Tan contact in the trapped gas. In complement to these observations, full quantum simulations of the experiment show that, under the right conditions, the depletion can persist into the far field after expansion. Moreover, the simulations provide mechanisms for survival and for the the large-momentum tails to appear stronger after expansion due to an acceleration of the depleted atoms by the mean-field potential. However, while in qualitative agreement, the final depletion observed in the experiment is much larger than in the simulation.


title: Signatures of r-process elements in kilonova spectra

abstract: Binary neutron star (NS) mergers have been expected to synthesize r-process elements and emit radioactively powered radiation, called kilonova. Although r-process nucleosynthesis was confirmed by the observations of GW170817/AT2017gfo, no trace of individual elements has been identified except for strontium. In this paper, we perform systematic calculations of line strength for bound-bound transitions and radiative transfer simulations in NS merger ejecta toward element identification in kilonova spectra. We find that Sr II triplet lines appear in the spectrum of a lanthanide-poor model, which is consistent with the absorption feature observed in GW170817/AT2017gfo. The synthetic spectrum also shows the strong Ca II triplet lines. This is natural because Ca and Sr are co-produced in the material with relatively high electron fraction and their ions have similar atomic structures with only one s-electron in the outermost shell. The line strength, however, highly depends on the abundance distribution and temperature in the ejecta. For our lanthanide-rich model, the spectra show the features of doubly ionized heavy elements, such as Ce, Tb and Th. Our results suggest that the line forming region of GW170817/AT2017gfo was lanthanide-poor. We show that the Sr II and Ca II lines can be used as a probe of physical conditions in NS merger ejecta. Absence of the Ca II line features in GW170817/AT2017gfo implies that the Ca/Sr ratio is < 0.002 in mass fraction, which is consistent with nucleosynthesis for electron fraction >= 0.40 and entropy per nucleon (in units of Boltzmann constant) >= 25.


title: A cooperative partial snapshot algorithm for checkpoint-rollback recovery of large-scale and dynamic distributed systems and experimental evaluations

abstract: A distributed system consisting of a huge number of computational entities is prone to faults, because faults in a few nodes cause the entire system to fail. Consequently, fault tolerance of distributed systems is a critical issue. Checkpoint-rollback recovery is a universal and representative technique for fault tolerance; it periodically records the entire system state (configuration) to non-volatile storage, and the system restores itself using the recorded configuration when the system fails. To record a configuration of a distributed system, a specific algorithm known as a snapshot algorithm is required. However, many snapshot algorithms require coordination among all nodes in the system; thus, frequent executions of snapshot algorithms require unacceptable communication cost, especially if the systems are large. As a sophisticated snapshot algorithm, a partial snapshot algorithm has been introduced that takes a partial snapshot (instead of a global snapshot). However, if two or more partial snapshot algorithms are concurrently executed, and their snapshot domains overlap, they should coordinate, so that the partial snapshots (taken by the algorithms) are consistent. In this paper, we propose a new efficient partial snapshot algorithm with the aim of reducing communication for the coordination. In a simulation, we show that the proposed algorithm drastically outperforms the existing partial snapshot algorithm, in terms of message and time complexity.


title: Phase diagram for Hole-Doped Kitaev System on the Honeycomb Lattice

abstract: In extended Kitaev models on the honeycomb lattice, off-diagonal interactions (e.g. the $\Gamma, \Gamma^{'}$ terms) give rise to non-Kitaev quantum spin liquid (QSL) and several magnetically ordered phases. In the present work, we dope holes to the system and study the resultant $t$-$K$-$\Gamma$-$\Gamma^{'}$ model by mean field theory. The interplay between the charge and spin degrees of freedom results in a rich phase diagram. Similar to doped cuprates, superconductors, pseudogap phases, fermi liquid, strange metal and paramagnetic phase are generated. What is different is that, more than one superconducting phases (including a topological one) and more than one pseudogap phases are obtained no matter what the original spin state is. The Chern number of the topological superconductor is either $\nu=\pm2$ or $\nu=\pm1$, depending on the ratio $\Gamma/ |K|$ in the spin channel. We further find that an intermediate in-plane magnetic field can slightly enlarge the size of the topological superconducting phase.


title: Order by disorder in frustration-free systems: a Quantum Monte Carlo study of a two-dimensional PXP model

abstract: In this study, an order by disorder mechanism has been proposed in a two-dimensional PXP model, where the extensive degeneracy of the classical ground-state manifold is due to strict occupation constraints instead of geometrical frustrations. By performing an unbias large-scale quantum monte carlos simulation, we find that local quantum fluctuations, which usually work against long-range ordering, lift the macroscopic classical degeneracy and give rise to a compressible ground state with charge-density-wave long-range order. A simple trial wavefunction has been proposed to capture the essence of the ground-state of the two-dimensional PXP model. The finite temperature properties of this model have also been studied, and we find a thermal phase transition with an universality class of two-dimensional Ising model.


title: Sharp bounds on the zeroth-order general Randi\'c index of trees in terms of domination number

abstract: The zeroth-order general Randi\'c index of graph $G=(V_G,E_G)$, denoted by $^0R_{\alpha}(G)$, is the sum of items $(d_{v})^{\alpha}$ over all vertices $v\in V_G$, where $\alpha$ is a pertinently chosen real number. In this paper, we obtain the sharp upper and lower bounds on $^0R_{\alpha}$ of trees with a domination number $\gamma$, in intervals $\alpha\in(-\infty,0)\cup(1,\infty)$ and $\alpha\in(0,1)$, respectively. The corresponding extremal graphs of these bounds are also characterized.


title: Dynamic Binary Translation for SGX Enclaves

abstract: Enclaves, such as those enabled by Intel SGX, offer a hardware primitive for shielding user-level applications from the OS. While enclaves are a useful starting point, code running in the enclave requires additional checks whenever control or data is transferred to/from the untrusted OS. The enclave-OS interface on SGX, however, can be extremely large if we wish to run existing unmodified binaries inside enclaves. This paper presents Ratel, a dynamic binary translation engine running inside SGX enclaves on Linux. Ratel offers complete interposition, the ability to interpose on all executed instructions in the enclave and monitor all interactions with the OS. Instruction-level interposition offers a general foundation for implementing a large variety of inline security monitors in the future. We take a principled approach in explaining why complete interposition on SGX is challenging. We draw attention to 5 design decisions in SGX that create fundamental trade-offs between performance and ensuring complete interposition, and we explain how to resolve them in the favor of complete interposition. To illustrate the utility of the Ratel framework, we present the first attempt to offer binary compatibility with existing software on SGX. We report that Ratel offers binary compatibility with over 200 programs we tested, including micro-benchmarks and real applications such as Linux shell utilities. Runtimes for two programming languages, namely Python and R, tested with standard benchmarks work out-of-the-box on Ratel without any specialized handling.


title: Transitional Learning: Exploring the Transition States of Degradation for Blind Super-resolution

abstract: Being extremely dependent on iterative estimation of the degradation prior or optimization of the model from scratch, the existing blind super-resolution (SR) methods are generally time-consuming and less effective, as the estimation of degradation proceeds from a blind initialization and lacks interpretable degradation priors. To address it, this paper proposes a transitional learning method for blind SR using an end-to-end network without any additional iterations in inference, and explores an effective representation for unknown degradation. To begin with, we analyze and demonstrate the transitionality of degradations as interpretable prior information to indirectly infer the unknown degradation model, including the widely used additive and convolutive degradations. We then propose a novel Transitional Learning method for blind Super-Resolution (TLSR), by adaptively inferring a transitional transformation function to solve the unknown degradations without any iterative operations in inference. Specifically, the end-to-end TLSR network consists of a degree of transitionality (DoT) estimation network, a homogeneous feature extraction network, and a transitional learning module. Quantitative and qualitative evaluations on blind SR tasks demonstrate that the proposed TLSR achieves superior performances and costs fewer complexities against the state-of-the-art blind SR methods. The code is available at github.com/YuanfeiHuang/TLSR.


title: Recurrence relations of poly-Cauchy numbers by the $r$-Stirling transform

abstract: We give some formulas of poly-Cauchy numbers by the $r$-Stirling transform. In the case of the classical or poly-Bernoulli numbers, the formulas are with Stirling numbers of the first kind. In our case of the classical or poly-Cauchy numbers, the formulas are with Stirling numbers of the second kind. We also discuss annihilation formulas for poly-Cauchy number with negative indices.


title: Deriving Laws for Developing Concurrent Programs in a Rely-Guarantee Style

abstract: This paper presents a theory for the refinement of shared-memory concurrent algorithms from specifications. We augment pre and post condition specifications with Jones' rely and guarantee conditions, all of which are encoded as commands within a wide-spectrum language. Program components are specified using either partial or total correctness versions of postcondition specifications. Operations on shared data structures and atomic machine operations (e.g. compare-and-swap) are specified using an atomic specification command. All the above constructs are defined in terms of a simple core language, based on a small set of primitive commands and a handful of operators. A comprehensive set of laws for refining such specifications to code is derived in the theory. The approach supports fine-grained concurrency, avoiding atomicity assumptions on expression evaluation and assignment commands. The theory has been formalised in Isabelle/HOL, and the refinement laws and supporting lemmas have been proven in Isabelle/HOL.


title: Monocular 3D Vehicle Detection Using Uncalibrated Traffic Cameras through Homography

abstract: This paper proposes a method to extract the position and pose of vehicles in the 3D world from a single traffic camera. Most previous monocular 3D vehicle detection algorithms focused on cameras on vehicles from the perspective of a driver, and assumed known intrinsic and extrinsic calibration. On the contrary, this paper focuses on the same task using uncalibrated monocular traffic cameras. We observe that the homography between the road plane and the image plane is essential to 3D vehicle detection and the data synthesis for this task, and the homography can be estimated without the camera intrinsics and extrinsics. We conduct 3D vehicle detection by estimating the rotated bounding boxes (r-boxes) in the bird's eye view (BEV) images generated from inverse perspective mapping. We propose a new regression target called tailed r-box and a dual-view network architecture which boosts the detection accuracy on warped BEV images. Experiments show that the proposed method can generalize to new camera and environment setups despite not seeing imaged from them during training.


title: "Weak AI" is Likely to Never Become "Strong AI", So What is its Greatest Value for us?

abstract: AI has surpassed humans across a variety of tasks such as image classification, playing games (e.g., go, "Starcraft" and poker), and protein structure prediction. However, at the same time, AI is also bearing serious controversies. Many researchers argue that little substantial progress has been made for AI in recent decades. In this paper, the author (1) explains why controversies about AI exist; (2) discriminates two paradigms of AI research, termed "weak AI" and "strong AI" (a.k.a. artificial general intelligence); (3) clarifies how to judge which paradigm a research work should be classified into; (4) discusses what is the greatest value of "weak AI" if it has no chance to develop into "strong AI".


title: Best-Buddy GANs for Highly Detailed Image Super-Resolution

abstract: We consider the single image super-resolution (SISR) problem, where a high-resolution (HR) image is generated based on a low-resolution (LR) input. Recently, generative adversarial networks (GANs) become popular to hallucinate details. Most methods along this line rely on a predefined single-LR-single-HR mapping, which is not flexible enough for the SISR task. Also, GAN-generated fake details may often undermine the realism of the whole image. We address these issues by proposing best-buddy GANs (Beby-GAN) for rich-detail SISR. Relaxing the immutable one-to-one constraint, we allow the estimated patches to dynamically seek the best supervision during training, which is beneficial to producing more reasonable details. Besides, we propose a region-aware adversarial learning strategy that directs our model to focus on generating details for textured areas adaptively. Extensive experiments justify the effectiveness of our method. An ultra-high-resolution 4K dataset is also constructed to facilitate future super-resolution research.


title: Elsa: Energy-based learning for semi-supervised anomaly detection

abstract: Anomaly detection aims at identifying deviant instances from the normal data distribution. Many advances have been made in the field, including the innovative use of unsupervised contrastive learning. However, existing methods generally assume clean training data and are limited when the data contain unknown anomalies. This paper presents Elsa, a novel semi-supervised anomaly detection approach that unifies the concept of energy-based models with unsupervised contrastive learning. Elsa instills robustness against any data contamination by a carefully designed fine-tuning step based on the new energy function that forces the normal data to be divided into classes of prototypes. Experiments on multiple contamination scenarios show the proposed model achieves SOTA performance. Extensive analyses also verify the contribution of each component in the proposed model. Beyond the experiments, we also offer a theoretical interpretation of why contrastive learning alone cannot detect anomalies under data contamination.


title: LiDAR R-CNN: An Efficient and Universal 3D Object Detector

abstract: LiDAR-based 3D detection in point cloud is essential in the perception system of autonomous driving. In this paper, we present LiDAR R-CNN, a second stage detector that can generally improve any existing 3D detector. To fulfill the real-time and high precision requirement in practice, we resort to point-based approach other than the popular voxel-based approach. However, we find an overlooked issue in previous work: Naively applying point-based methods like PointNet could make the learned features ignore the size of proposals. To this end, we analyze this problem in detail and propose several methods to remedy it, which bring significant performance improvement. Comprehensive experimental results on real-world datasets like Waymo Open Dataset (WOD) and KITTI dataset with various popular detectors demonstrate the universality and superiority of our LiDAR R-CNN. In particular, based on one variant of PointPillars, our method could achieve new state-of-the-art results with minor cost. Codes will be released at https://github.com/tusimple/LiDAR_RCNN .


title: Empirical Welfare Maximization with Constraints

abstract: When designing eligibility criteria for welfare programs, policymakers naturally want to target the individuals who will benefit the most. This paper proposes two new econometric approaches to selecting an optimal eligibility criterion when individuals' costs to the program are unknown and need to be estimated. One is designed to achieve the highest benefit possible while satisfying a budget constraint with high probability. The other is designed to optimally trade off the benefit and the cost from violating the budget constraint. The setting I consider extends the previous literature on Empirical Welfare Maximization by allowing for uncertainty in estimating the budget needed to implement the criterion, in addition to its benefit. Consequently, my approaches improve the existing approach as they can be applied to settings with imperfect take-up or varying program needs. I illustrate my approaches empirically by deriving an optimal budget-constrained Medicaid expansion in the US.


title: Bounding the photon mass with cosmological propagation of fast radio bursts

abstract: Photon is the fundamental quantum of electromagnetic fields, whose mass, $m_{\gamma}$, should be strictly zero in Maxwell's theory. But not all theories adopt this hypothesis. If the rest mass of the photon is not zero, there will be an additional time delay between photons of different frequencies after they travel through a fixed distance. By analyzing the time delay, we can measure or constrain the photon mass. Fast radio bursts (FRBs) -- transient radio bursts characterized by millisecond duration and cosmological propagation -- are excellent astrophysical laboratories to constrain $m_{\gamma}$. In this work we use a catalog of 129 FRBs in a Bayesian framework to constrain $m_{\gamma}$. As a result, we obtain a new bound on the photon mass, $m_{\gamma} \leq 3.1\times 10^{-51}\rm\,kg\simeq 1.7 \times 10^{-15}\,eV/c^2$ ($m_{\gamma} \leq 3.9\times 10^{-51}\rm\,kg \simeq 2.2 \times 10^{-15}\,eV/c^2$) at the $68\%$ $(95\%$) confidence level. The result represents the best limit purely from kinematic analysis of light propagation. The bound on the photon mass will be tighter in the near future with increment in the number of FRBs, more accurate measurement of the redshift for FRBs, and refinement in the knowledge about the origin of dispersion measures (DMs).


title: Global L-packets of quasisplit $GSp(2n)$ and $GO(2n)$

abstract: This is a sequel to [Xu18] on the $L$-packets of quasisplit general symplectic and even orthogonal groups. We show the existence of global $L$-packets and establish the functoriality of endoscopic transfer for them in many cases.


title: Chaotic scattering of highly excited strings

abstract: Motivated by the desire to understand chaos in the $S$-matrix of string theory, we study tree level scattering amplitudes involving highly excited strings. While the amplitudes for scattering of light strings have been a hallmark of string theory since its early days, scattering of excited strings has been far less studied. Recent results on black hole chaos, combined with the correspondence principle between black holes and strings, suggest that the amplitudes have a rich structure. We review the procedure by which an excited string is formed by repeatedly scattering photons off of an initial tachyon (the DDF formalism). We compute the scattering amplitude of one arbitrary excited string and any number of tachyons in bosonic string theory. At high energies and high mass excited state these amplitudes are determined by a saddle-point in the integration over the positions of the string vertex operators on the sphere (or the upper half plane), thus yielding a generalization of the "scattering equations". We find a compact expression for the amplitude of an excited string decaying into two tachyons, and study its properties for a generic excited string. We find the amplitude is highly erratic as a function of both the precise excited string state and of the tachyon scattering angle relative to its polarization, a sign of chaos.


title: Analytic formula for option margin with liquidity costs under dynamic delta hedging

abstract: This study derives the expected liquidity cost when performing the delta hedging process of a European option. This cost is represented by an integration formula that includes European option prices and a certain function depending on the delta process. We first define a unit liquidity cost and then show that the liquidity cost is a multiplication of the unit liquidity cost, stock price, supply curve parameter, and the square of the number of options. Using this formula, the expected liquidity cost before hedging can be calculated much faster than when using a Monte Carlo simulation. Numerically computed distributions of liquidity costs in special cases are also provided.


title: Surface Acoustic Wave induced modulation of tunneling magnetoresistance in magnetic tunnel junctions

abstract: We show that a surface acoustic wave (SAW) applied across the terminals of a magnetic tunnel junction (MTJ) decreases both the (time-averaged) parallel and antiparallel resistances of the MTJ, with the latter decreasing much more than the former. This results in a decrease of the tunneling magnetoresistance (TMR) ratio. The coercivities of the free and fixed layer of the MTJ, however, are not affected significantly, suggesting that the SAW does not cause large-angle magnetization rotation in the magnetic layers through the inverse magnetostriction (Villari) effect at the power levels used. This study sheds light on the dynamical behavior of an MTJ under periodic compressive and tensile strain.


title: A Comparative Evaluation of Predominant Deep Learning Quantified Stock Trading Strategies

abstract: This study first reconstructs three deep learning powered stock trading models and their associated strategies that are representative of distinct approaches to the problem and established upon different aspects of the many theories evolved around deep learning. It then seeks to compare the performance of these strategies from different perspectives through trading simulations ran on three scenarios when the benchmarks are kept at historical low points for extended periods of time. The results show that in extremely adverse market climates, investment portfolios managed by deep learning powered algorithms are able to avert accumulated losses by generating return sequences that shift the constantly negative CSI 300 benchmark return upward. Among the three, the LSTM model's strategy yields the best performance when the benchmark sustains continued loss.


title: Scaling sparsemax based channel selection for speech recognition with ad-hoc microphone arrays

abstract: Recently, speech recognition with ad-hoc microphone arrays has received much attention. It is known that channel selection is an important problem of ad-hoc microphone arrays, however, this topic seems far from explored in speech recognition yet, particularly with a large-scale ad-hoc microphone array. To address this problem, we propose a Scaling Sparsemax algorithm for the channel selection problem of the speech recognition with large-scale ad-hoc microphone arrays. Specifically, we first replace the conventional Softmax operator in the stream attention mechanism of a multichannel end-to-end speech recognition system with Sparsemax, which conducts channel selection by forcing the channel weights of noisy channels to zero. Because Sparsemax punishes the weights of many channels to zero harshly, we propose Scaling Sparsemax which punishes the channels mildly by setting the weights of very noisy channels to zero only. Experimental results with ad-hoc microphone arrays of over 30 channels under the conformer speech recognition architecture show that the proposed Scaling Sparsemax yields a word error rate of over 30% lower than Softmax on simulation data sets, and over 20% lower on semi-real data sets, in test scenarios with both matched and mismatched channel numbers.


title: Checkerboard Context Model for Efficient Learned Image Compression

abstract: For learned image compression, the autoregressive context model is proved effective in improving the rate-distortion (RD) performance. Because it helps remove spatial redundancies among latent representations. However, the decoding process must be done in a strict scan order, which breaks the parallelization. We propose a parallelizable checkerboard context model (CCM) to solve the problem. Our two-pass checkerboard context calculation eliminates such limitations on spatial locations by re-organizing the decoding order. Speeding up the decoding process more than 40 times in our experiments, it achieves significantly improved computational efficiency with almost the same rate-distortion performance. To the best of our knowledge, this is the first exploration on parallelization-friendly spatial context model for learned image compression.


title: Onfocus Detection: Identifying Individual-Camera Eye Contact from Unconstrained Images

abstract: Onfocus detection aims at identifying whether the focus of the individual captured by a camera is on the camera or not. Based on the behavioral research, the focus of an individual during face-to-camera communication leads to a special type of eye contact, i.e., the individual-camera eye contact, which is a powerful signal in social communication and plays a crucial role in recognizing irregular individual status (e.g., lying or suffering mental disease) and special purposes (e.g., seeking help or attracting fans). Thus, developing effective onfocus detection algorithms is of significance for assisting the criminal investigation, disease discovery, and social behavior analysis. However, the review of the literature shows that very few efforts have been made toward the development of onfocus detector due to the lack of large-scale public available datasets as well as the challenging nature of this task. To this end, this paper engages in the onfocus detection research by addressing the above two issues. Firstly, we build a large-scale onfocus detection dataset, named as the OnFocus Detection In the Wild (OFDIW). It consists of 20,623 images in unconstrained capture conditions (thus called ``in the wild'') and contains individuals with diverse emotions, ages, facial characteristics, and rich interactions with surrounding objects and background scenes. On top of that, we propose a novel end-to-end deep model, i.e., the eye-context interaction inferring network (ECIIN), for onfocus detection, which explores eye-context interaction via dynamic capsule routing. Finally, comprehensive experiments are conducted on the proposed OFDIW dataset to benchmark the existing learning models and demonstrate the effectiveness of the proposed ECIIN. The project (containing both datasets and codes) is at https://github.com/wintercho/focus.


title: Stability of Multi-Microgrids: New Certificates, Distributed Control, and Braess's Paradox

abstract: This paper investigates the theory of resilience and stability in multi-microgrid networks. We derive new sufficient conditions to guarantee small-signal stability of multi-microgrids in both lossless and lossy networks. The new stability certificate for lossy networks only requires local information, thus leads to a fully distributed control scheme. Moreover, we study the impact of network topology, interface parameters (virtual inertia and damping), and local measurements (voltage magnitude and reactive power) on the stability of the system. The proposed stability certificate suggests the existence of Braess's Paradox in the stability of multi-microgrids, i.e. adding more connections between microgrids could worsen the multi-microgrid system stability as a whole. We also extend the presented analysis to structure-preserving network models, and provide a stability certificate as a function of original network parameters, instead of the Kron reduced network parameters. We provide a detailed numerical study of the proposed certificate, the distributed control scheme, and a coordinated control approach with line switching. The simulation shows the effectiveness of the proposed stability conditions and control schemes in a four-microgrid network, IEEE 33-bus system, and several large-scale synthetic grids.


title: Robust Feedback Motion Policy Design Using Reinforcement Learning on a 3D Digit Bipedal Robot

abstract: In this paper, a hierarchical and robust framework for learning bipedal locomotion is presented and successfully implemented on the 3D biped robot Digit built by Agility Robotics. We propose a cascade-structure controller that combines the learning process with intuitive feedback regulations. This design allows the framework to realize robust and stable walking with a reduced-dimension state and action spaces of the policy, significantly simplifying the design and reducing the sampling efficiency of the learning method. The inclusion of feedback regulation into the framework improves the robustness of the learned walking gait and ensures the success of the sim-to-real transfer of the proposed controller with minimal tuning. We specifically present a learning pipeline that considers hardware-feasible initial poses of the robot within the learning process to ensure the initial state of the learning is replicated as close as possible to the initial state of the robot in hardware experiments. Finally, we demonstrate the feasibility of our method by successfully transferring the learned policy in simulation to the Digit robot hardware, realizing sustained walking gaits under external force disturbances and challenging terrains not included during the training process. To the best of our knowledge, this is the first time a learning-based policy is transferred successfully to the Digit robot in hardware experiments without using dynamic randomization or curriculum learning.


title: Monte Carlo algorithm for the extrema of tempered stable processes

abstract: We develop a novel Monte Carlo algorithm for the vector consisting of the supremum, the time at which the supremum is attained and the position at a given (constant) time of an exponentially tempered L\'evy process. The algorithm, based on the increments of the process without tempering, converges geometrically fast (as a function of the computational cost) for discontinuous and locally Lipschitz functions of the vector. We prove that the corresponding multilevel Monte Carlo estimator has optimal computational complexity (i.e. of order $\varepsilon^{-2}$ if the mean squared error is at most $\varepsilon^2$) and provide its central limit theorem (CLT). Using the CLT we construct confidence intervals for barrier option prices and various risk measures based on drawdown under the tempered stable (CGMY) model calibrated/estimated on real-world data. We provide non-asymptotic and asymptotic comparisons of our algorithm with existing approximations, leading to rule-of-thumb guidelines for users to the best method for a given set of parameters. We illustrate the performance of the algorithm with numerical examples.


title: Optimal False Discovery Rate Control for Large Scale Multiple Testing with Auxiliary Information

abstract: Large-scale multiple testing is a fundamental problem in high dimensional statistical inference. It is increasingly common that various types of auxiliary information, reflecting the structural relationship among the hypotheses, are available. Exploiting such auxiliary information can boost statistical power. To this end, we propose a framework based on a two-group mixture model with varying probabilities of being null for different hypotheses a priori, where a shape-constrained relationship is imposed between the auxiliary information and the prior probabilities of being null. An optimal rejection rule is designed to maximize the expected number of true positives when average false discovery rate is controlled. Focusing on the ordered structure, we develop a robust EM algorithm to estimate the prior probabilities of being null and the distribution of $p$-values under the alternative hypothesis simultaneously. We show that the proposed method has better power than state-of-the-art competitors while controlling the false discovery rate, both empirically and theoretically. Extensive simulations demonstrate the advantage of the proposed method. Datasets from genome-wide association studies are used to illustrate the new methodology.


title: Baryogenesis in $f(P)$ Gravity

abstract: In this work, we investigate gravitational baryogenesis in the framework of $f(P)$ gravity to understand the applicability of this class of modified gravity in addressing the baryon asymmetry of the Universe. For the analysis, we set $f(P) = \alpha P$ where $\alpha$ is the model parameter. We found that in $f(P)$ gravity, the CP-violating interaction acquires a modification through the addition of the nontopological cubic term $P$ in addition to the Ricci scalar $R$ and the mathematical expression of the baryon-to-entropy ratio depends not only on the time derivative of $R$ but also the time derivative of $P$. Additionally, we also investigate the consequences of a more complete and generalized CP-violating interaction proportional to $f(P)$ instead of $P$ in addressing the baryon asymmetry of the Universe. For this type of interaction, we report that the baryon-to-entropy ratio is proportional to $\dot{R}$, $\dot{P}$ and $f^{'}(P)$. We report that for both of these cases, rational values of $\alpha$ and $\chi$ generate acceptable baryon-to-entropy ratios compatible with observations.


title: Neutrino signals of lightcone fluctuations resulting from fluctuating space-time

abstract: One of the most common expectations of a quantum theory of gravity is that space-time is uncertain or fluctuating at microscopic scales, making it a stochastic medium for particle propagation. Particles traversing this space-time may experience fluctuations in travel times or velocities, together referred to as lightcone fluctuations, with even very small effects potentially accumulating into observable signals over large distances. In this work we present a heuristic model of lightcone fluctuations and study the resulting modifications to neutrino propagation, including neutrino decoherence and arrival time spread. We show the expected scale of such effects due to `natural' Planck scale physics and consider how they may be observed in neutrino detectors, and compare the potential of neutrinos to $\gamma$-ray astronomy. Using simulations of neutrino mass states propagating in a fluctuating environment, we determine an analytic decoherence operator in the framework of open quantum systems to quantitatively evaluate neutrino decoherence resulting from lightcone fluctuations, allowing experimental constraints on neutrino decoherence to be connected to Planck scale fluctuations in space-time and $\gamma$-ray results.


title: Galactic Orbital Effects on Pulsar Timing

abstract: In the currently accepted paradigm, dark matter is hypothesized as an explanation of the flat rotation curves of galaxies under the assumption of virialized orbits. The use of millisecond pulsar timing as a probe of Galactic dark matter content is explored as a means of relaxing this assumption. A method of inference of the Galactic potential using the frequency derivative $\dot{\nu}$ is produced, and an estimate for a virialized Galactic rotation curve is given through direct observation of acceleration. The data set used includes 210 pulsars with known $\dot{\nu}$ and astrometric properties, a subset of which also have measured $\ddot{\nu}$. In principle, this enables the exploration of kinematic effects, but in practice, $\ddot{\nu}$ values are found to be too imprecise at present to adequately constrain radial velocities of pulsars. Additionally, surface magnetic field strengths are inferred from $\dot{\nu}$ and the magnetic spin-down contribution to $\ddot{\nu}$ is estimated. For several pulsars the radial velocity is known, and the kinematic contribution to $\ddot{\nu}$ is estimated accordingly. The binary orbital periods of PSR J1713+0747 and other binary pulsars are also used to constrain Galactic mass density models.


title: A mesoscale model for quantitative phospholipid monolayer simulations at the air-water interface

abstract: A mesoscale model with molecular resolutions is presented for the dipalmitoyl-phosphatidylcholine (DPPC) and 1-palmitoyl-2-oleyl-sn-glycero-3-phosphocholine (POPC) monolayer simulations at the air-water interface using many-body dissipative particle dynamics (MDPD). The parameterization scheme is rigorously based on reproducing the physical properties of water and alkane and the interfacial property of the phospholipid monolayer by comparing with our experimental results. The MDPD model yields a similar surface pressure-area isotherm as well as the similar pressure-related morphologies compared with the all-atomistic simulations and experiments. Moreover, the compressibility modulus, order parameter of lipid tails, and thickness of the MDPD phospholipid monolayer are quantitatively in line with the all-atomistic simulations and experiments. This model can also capture the sensitive changes in the pressure-area isotherms of the mixed DPPC/POPC monolayers with altered mixed ratios by comparing with the experiments, indicating that our model scheme is promising in applications for complex natural phospholipid monolayers. These results demonstrate a significant improvement on quantitative phospholipid monolayer simulations over the previous coarse-grained models.


title: Whitening Sentence Representations for Better Semantics and Faster Retrieval

abstract: Pre-training models such as BERT have achieved great success in many natural language processing tasks. However, how to obtain better sentence representation through these pre-training models is still worthy to exploit. Previous work has shown that the anisotropy problem is an critical bottleneck for BERT-based sentence representation which hinders the model to fully utilize the underlying semantic features. Therefore, some attempts of boosting the isotropy of sentence distribution, such as flow-based model, have been applied to sentence representations and achieved some improvement. In this paper, we find that the whitening operation in traditional machine learning can similarly enhance the isotropy of sentence representations and achieve competitive results. Furthermore, the whitening technique is also capable of reducing the dimensionality of the sentence representation. Our experimental results show that it can not only achieve promising performance but also significantly reduce the storage cost and accelerate the model retrieval speed.


title: Ground Encoding: Learned Factor Graph-based Models for Localizing Ground Penetrating Radar

abstract: We address the problem of robot localization using ground penetrating radar (GPR) sensors. Current approaches for localization with GPR sensors require a priori maps of the system's environment as well as access to approximate global positioning (GPS) during operation. In this paper, we propose a novel, real-time GPR-based localization system for unknown and GPS-denied environments. We model the localization problem as an inference over a factor graph. Our approach combines 1D single-channel GPR measurements to form 2D image submaps. To use these GPR images in the graph, we need sensor models that can map noisy, high-dimensional image measurements into the state space. These are challenging to obtain a priori since image generation has a complex dependency on subsurface composition and radar physics, which itself varies with sensors and variations in subsurface electromagnetic properties. Our key idea is to instead learn relative sensor models directly from GPR data that map non-sequential GPR image pairs to relative robot motion. These models are incorporated as factors within the factor graph with relative motion predictions correcting for accumulated drift in the position estimates. We demonstrate our approach over datasets collected across multiple locations using a custom designed experimental rig. We show reliable, real-time localization using only GPR and odometry measurements for varying trajectories in three distinct GPS-denied environments. For our supplementary video, see https://youtu.be/HXXgdTJzqyw.


title: Uplink Channel Impulse Response Based Secondary Carrier Prediction

abstract: A typical handover problem requires sequence of complex signaling between a UE, the serving, and target base station. In many handover problems the down link based measurements are transferred from a user equipment to a serving base station and the decision on handover is made on these measurements. These measurements together with the signaling between the user equipment and the serving base station is computationally expensive and can potentially drain user equipment battery. Coupled with this, the future networks are densely deployed with multiple frequency layers, rendering current handover mechanisms sub-optimal, necessitating newer methods that can improve energy efficiency. In this study, we will investigate a ML based approach towards secondary carrier prediction for inter-frequency handover using the up-link reference signals.


title: Bayesian Attention Networks for Data Compression

abstract: The lossless data compression algorithm based on Bayesian Attention Networks is derived from first principles. Bayesian Attention Networks are defined by introducing an attention factor per a training sample loss as a function of two sample inputs, from training sample and prediction sample. By using a sharpened Jensen's inequality we show that the attention factor is completely defined by a correlation function of the two samples w.r.t. the model weights. Due to the attention factor the solution for a prediction sample is mostly defined by a few training samples that are correlated with the prediction sample. Finding a specific solution per prediction sample couples together the training and the prediction. To make the approach practical we introduce a latent space to map each prediction sample to a latent space and learn all possible solutions as a function of the latent space along with learning attention as a function of the latent space and a training sample. The latent space plays a role of the context representation with a prediction sample defining a context and a learned context dependent solution used for the prediction.


title: TFPose: Direct Human Pose Estimation with Transformers

abstract: We propose a human pose estimation framework that solves the task in the regression-based fashion. Unlike previous regression-based methods, which often fall behind those state-of-the-art methods, we formulate the pose estimation task into a sequence prediction problem that can effectively be solved by transformers. Our framework is simple and direct, bypassing the drawbacks of the heatmap-based pose estimation. Moreover, with the attention mechanism in transformers, our proposed framework is able to adaptively attend to the features most relevant to the target keypoints, which largely overcomes the feature misalignment issue of previous regression-based methods and considerably improves the performance. Importantly, our framework can inherently take advantages of the structured relationship between keypoints. Experiments on the MS-COCO and MPII datasets demonstrate that our method can significantly improve the state-of-the-art of regression-based pose estimation and perform comparably with the best heatmap-based pose estimation methods.


title: Generation of transversely oriented optical polarization M\"obius strips

abstract: We report a time-reversal method based on the Richards-Wolf vectorial diffraction theory to generate transversely oriented optical M\"obius strips that wander around an axis perpendicular to the beam propagation direction. A number of sets of dipole antennae are purposefully positioned on a prescribed trajectory in the y = 0 plane and the radiation fields are collected by one high-NA objective lens. By sending the complex conjugate of the radiation fields in a time-reversed manner, the focal fields are calculated and the optical polarization topology on the trajectory can be tailored to form prescribed M\"obius strips. The method can be extended to construct various polarization topologies on three-dimensional trajectories in the focal region. The ability to control optical polarization topologies may find applications in nanofabrication, quantum communications, and light-matter interactions.