title: Packed Words and Quotient Rings

abstract: The coinvariant algebra is a quotient of the polynomial ring $\mathbb{Q}[x_1,\ldots,x_n]$ whose algebraic properties are governed by the combinatorics of permutations of length $n$. A word $w = w_1 \dots w_n$ over the positive integers is packed if whenever $i > 2$ appears as a letter of $w$, so does $i-1$. We introduce a quotient $S_n$ of $\mathbb{Q}[x_1,\ldots,x_n]$ which is governed by the combinatorics of packed words. We relate our quotient $S_n$ to the generalized coinvariant rings of Haglund, Rhoades, and Shimozono as well as the superspace coinvariant ring.


title: Probing the screening of the Casimir interaction with optical tweezers

abstract: We measure the colloidal interaction between two silica microspheres in aqueous solution in the distance range from $0.2\,\mu$m to $0.5\,\mu$m with the help of optical tweezers. When employing a sample with a low salt concentration, the resulting interaction is dominated by the repulsive double-layer interaction which is fully characterized. The double-layer interaction is suppressed when adding $0.22\,$M of salt to our sample, thus leading to a purely attractive Casimir signal. When analyzing the experimental data for the potential energy and force, we find good agreement with theoretical results based on the scattering approach. At the distance range probed experimentally, the interaction arises mainly from the unscreened transverse magnetic contribution in the zero-frequency limit, with nonzero Matsubara frequencies providing a negligible contribution. In contrast, such unscreened contribution is not included by the standard theoretical model of the Casimir interaction in electrolyte solutions, in which the zero-frequency term is treated separately as an electrostatic fluctuational effect. As a consequence, the resulting attraction is too weak in this standard model, by approximately one order of magnitude, to explain the experimental data. Overall, our experimental results shed light on the nature of the thermal zero-frequency contribution and indicate that the Casimir attraction across polar liquids has a longer range than previously predicted.


title: Online Learning Probabilistic Event Calculus Theories in Answer Set Programming

abstract: Complex Event Recognition (CER) systems detect event occurrences in streaming time-stamped input using predefined event patterns. Logic-based approaches are of special interest in CER, since, via Statistical Relational AI, they combine uncertainty-resilient reasoning with time and change, with machine learning, thus alleviating the cost of manual event pattern authoring. We present a system based on Answer Set Programming (ASP), capable of probabilistic reasoning with complex event patterns in the form of weighted rules in the Event Calculus, whose structure and weights are learnt online. We compare our ASP-based implementation with a Markov Logic-based one and with a number of state-of-the-art batch learning algorithms on CER datasets for activity recognition, maritime surveillance and fleet management. Our results demonstrate the superiority of our novel approach, both in terms of efficiency and predictive performance. This paper is under consideration for publication in Theory and Practice of Logic Programming (TPLP).


title: Towards Prior-Free Approximately Truthful One-Shot Auction Learning via Differential Privacy

abstract: Designing truthful, revenue maximizing auctions is a core problem of auction design. Multi-item settings have long been elusive. Recent work (arXiv:1706.03459) introduces effective deep learning techniques to find such auctions for the prior-dependent setting, in which distributions about bidder preferences are known. One remaining problem is to obtain priors in a way that excludes the possibility of manipulating the resulting auctions. Using techniques from differential privacy for the construction of approximately truthful mechanisms, we modify the RegretNet approach to be applicable to the prior-free setting. In this more general setting, no distributional information is assumed, but we trade this property for worse performance. We present preliminary empirical results and qualitative analysis for this work in progress.


title: Finite groups whose prime graph on class sizes is a block square

abstract: Let $G$ be a finite group, and let $\Delta(G)$ be the prime graph built on its set of conjugacy class sizes: this is the (simple undirected) graph whose vertices are the prime numbers dividing some conjugacy class size of $G$, and two distinct vertices $p, q$ are adjacent if and only if $pq$ divides some class size of $G$. In this paper, we characterise the structure of those groups $G$ whose prime graph $\Delta(G)$ is a block square.


title: Scalable Visual Attribute Extraction through Hidden Layers of a Residual ConvNet

abstract: Visual attributes play an essential role in real applications based on image retrieval. For instance, the extraction of attributes from images allows an eCommerce search engine to produce retrieval results with higher precision. The traditional manner to build an attribute extractor is by training a convnet-based classifier with a fixed number of classes. However, this approach does not scale for real applications where the number of attributes changes frequently. Therefore in this work, we propose an approach for extracting visual attributes from images, leveraging the learned capability of the hidden layers of a general convolutional network to discriminate among different visual features. We run experiments with a resnet-50 trained on Imagenet, on which we evaluate the output of its different blocks to discriminate between colors and textures. Our results show that the second block of the resnet is appropriate for discriminating colors, while the fourth block can be used for textures. In both cases, the achieved accuracy of attribute classification is superior to 93%. We also show that the proposed embeddings form local structures in the underlying feature space, which makes it possible to apply reduction techniques like UMAP, maintaining high accuracy and widely reducing the size of the feature space.


title: Point-free Construction of Real Exponentiation

abstract: We define a point-free construction of real exponentiation and logarithms, i.e.\ we construct the maps $\exp\colon (0, \infty)\times \mathbb{R} \rightarrow \!(0,\infty),\, (x, \zeta) \mapsto x^\zeta$ and $\log\colon (1,\infty)\times (0, \infty) \rightarrow\mathbb{R},\, (b, y) \mapsto \log_b(y)$, and we develop familiar algebraic rules for them. The point-free approach is constructive, and defines the points of a space as models of a geometric theory, rather than as elements of a set - in particular, this allows geometric constructions to be applied to points living in toposes other than Set. Our geometric development includes new lifting and gluing techniques in point-free topology, which highlight how properties of $\mathbb{Q}$ determine properties of real exponentiation. This work is motivated by our broader research programme of developing a version of adelic geometry via topos theory. In particular, we wish to construct the classifying topos of places of $\mathbb{Q}$, which will provide a geometric perspective into the subtle relationship between $\mathbb{R}$ and $\mathbb{Q}_p$, a question of longstanding number-theoretic interest.


title: DEALIO: Data-Efficient Adversarial Learning for Imitation from Observation

abstract: In imitation learning from observation IfO, a learning agent seeks to imitate a demonstrating agent using only observations of the demonstrated behavior without access to the control signals generated by the demonstrator. Recent methods based on adversarial imitation learning have led to state-of-the-art performance on IfO problems, but they typically suffer from high sample complexity due to a reliance on data-inefficient, model-free reinforcement learning algorithms. This issue makes them impractical to deploy in real-world settings, where gathering samples can incur high costs in terms of time, energy, and risk. In this work, we hypothesize that we can incorporate ideas from model-based reinforcement learning with adversarial methods for IfO in order to increase the data efficiency of these methods without sacrificing performance. Specifically, we consider time-varying linear Gaussian policies, and propose a method that integrates the linear-quadratic regulator with path integral policy improvement into an existing adversarial IfO framework. The result is a more data-efficient IfO algorithm with better performance, which we show empirically in four simulation domains: using far fewer interactions with the environment, the proposed method exhibits similar or better performance than the existing technique.


title: Time Series Analysis and Modeling to Forecast: a Survey

abstract: Time series modeling for predictive purpose has been an active research area of machine learning for many years. However, no sufficiently comprehensive and meanwhile substantive survey was offered so far. This survey strives to meet this need. A unified presentation has been adopted for entire parts of this compilation. A red thread guides the reader from time series preprocessing to forecasting. Time series decomposition is a major preprocessing task, to separate nonstationary effects (the deterministic components) from the remaining stochastic constituent, assumed to be stationary. The deterministic components are predictable and contribute to the prediction through estimations or extrapolation. Fitting the most appropriate model to the remaining stochastic component aims at capturing the relationship between past and future values, to allow prediction. We cover a sufficiently broad spectrum of models while nonetheless offering substantial methodological developments. We describe three major linear parametric models, together with two nonlinear extensions, and present five categories of nonlinear parametric models. Beyond conventional statistical models, we highlight six categories of deep neural networks appropriate for time series forecasting in nonlinear framework. Finally, we enlighten new avenues of research for time series modeling and forecasting. We also report software made publicly available for the models presented.


title: Encoding Event-Based Data With a Hybrid SNN Guided Variational Auto-encoder in Neuromorphic Hardware

abstract: Neuromorphic hardware equipped with learning capabilities can adapt to new, real-time data. While models of Spiking Neural Networks (SNNs) can now be trained using gradient descent to reach an accuracy comparable to equivalent conventional neural networks, such learning often relies on external labels. However, real-world data is unlabeled which can make supervised methods inapplicable. To solve this problem, we propose a Hybrid Guided Variational Autoencoder (VAE) which encodes event based data sensed by a Dynamic Vision Sensor (DVS) into a latent space representation using an SNN. These representations can be used as an embedding to measure data similarity and predict labels in real-world data. We show that the Hybrid Guided-VAE achieves 87% classification accuracy on the DVSGesture dataset and it can encode the sparse, noisy inputs into an interpretable latent space representation, visualized through T-SNE plots. We also implement the encoder component of the model on neuromorphic hardware and discuss the potential for our algorithm to enable real-time learning from real-world event data.


title: A Semidefinite Programming Approach to Discrete-time Infinite Horizon Persistent Monitoring

abstract: We investigate the problem of persistent monitoring, where a mobile agent has to survey multiple targets in an environment in order to estimate their internal states. These internal states evolve with linear stochastic dynamics and the agent can observe them with a linear observation model. However, the signal to noise ratio is a monotonically decreasing function of the distance between the agent and the target. The goal is to minimize the uncertainty in the state estimates over the infinite horizon. We show that, for a periodic trajectory with fixed cycle length, the problem can be formulated as a set of semidefinite programs. We design a scheme that leverages the spatial configuration of the targets to guide the search over this set of optimization problems in order to provide efficient trajectories. Results are compared to a state of the art approach and we obtain improvements of up to 91% in terms of cost in a simple scenario, with much lower computational time.


title: A unified approach to hypergraph stability

abstract: We present a method which provides a unified framework for most stability theorems that have been proved in graph and hypergraph theory. Our main result reduces stability for a large class of hypergraph problems to the simpler question of checking that a hypergraph $\mathcal H$ with large minimum degree that omits the forbidden structures is vertex-extendable. This means that if $v$ is a vertex of $\mathcal H$ and ${\mathcal H} -v$ is a subgraph of the extremal configuration(s), then $\mathcal H$ is also a subgraph of the extremal configuration(s). In many cases vertex-extendability is quite easy to verify. We illustrate our approach by giving new short proofs of hypergraph stability results of Pikhurko, Hefetz-Keevash, Brandt-Irwin-Jiang, Bene Watts-Norin-Yepremyan and others. Since our method always yields minimum degree stability, which is the strongest form of stability, in some of these cases our stability results are stronger than what was known earlier. Along the way, we clarify the different notions of stability that have been previously studied.


title: Absolute sets of rigid local systems

abstract: The absolute sets of local systems on a smooth complex algebraic variety are the subject of a conjecture of N. Budur and B. Wang based on an analogy with special subvarieties of Shimura varieties. An absolute set should be the higher-dimensional generalization of a local system of geometric origin. We show that the conjecture for absolute sets of simple cohomologically rigid local systems reduces to the zero-dimensional case, that is, to Simpson's conjecture that every such local system with quasi-unipotent monodromy at infinity and determinant is of geometric origin. In particular, the conjecture holds for this type of absolute sets if the variety is a curve or if the rank is two.


title: Improved and efficient inter-vehicle distance estimation using road gradients of both ego and target vehicles

abstract: In advanced driver assistant systems and autonomous driving, it is crucial to estimate distances between an ego vehicle and target vehicles. Existing inter-vehicle distance estimation methods assume that the ego and target vehicles drive on a same ground plane. In practical driving environments, however, they may drive on different ground planes. This paper proposes an inter-vehicle distance estimation framework that can consider slope changes of a road forward, by estimating road gradients of \emph{both} ego vehicle and target vehicles and using a 2D object detection deep net. Numerical experiments demonstrate that the proposed method significantly improves the distance estimation accuracy and time complexity, compared to deep learning-based depth estimation methods.


title: Are Bias Mitigation Techniques for Deep Learning Effective?

abstract: A critical problem in deep learning is that systems learn inappropriate biases, resulting in their inability to perform well on minority groups. This has led to the creation of multiple algorithms that endeavor to mitigate bias. However, it is not clear how effective these methods are. This is because study protocols differ among papers, systems are tested on datasets that fail to test many forms of bias, and systems have access to hidden knowledge or are tuned specifically to the test set. To address this, we introduce an improved evaluation protocol, sensible metrics, and a new dataset, which enables us to ask and answer critical questions about bias mitigation algorithms. We evaluate seven state-of-the-art algorithms using the same network architecture and hyperparameter selection policy across three benchmark datasets. We introduce a new dataset called Biased MNIST that enables assessment of robustness to multiple bias sources. We use Biased MNIST and a visual question answering (VQA) benchmark to assess robustness to hidden biases. Rather than only tuning to the test set distribution, we study robustness across different tuning distributions, which is critical because for many applications the test distribution may not be known during development. We find that algorithms exploit hidden biases, are unable to scale to multiple forms of bias, and are highly sensitive to the choice of tuning set. Based on our findings, we implore the community to adopt more rigorous assessment of future bias mitigation methods. All data, code, and results are publicly available at: https://github.com/erobic/bias-mitigators.


title: The Effect on Topology of the Action of a Unipotent Group

abstract: Assume that two algebraic varieties of finite type over the complex numbers are related by a morphism whose fibers are precisely the orbits for the action of a unipotent group. We show that the two varieties have the same topological Euler characteristic. If they are smooth and the morphism is smooth, we show that the two varieties have the same cohomology groups.


title: A Revised SALT2 Surface for Fitting Type Ia Supernova Light Curves

abstract: We present a revised SALT2 surface (`SALT2-2021') for fitting the light curves of Type Ia supernovae (SNe Ia), which incorporates new measurements of zero-point calibration offsets and Milky Way extinction. The most notable change in the new surface occurs in the UV region. This new surface alters the distance measurements of SNe~Ia, which can be used to investigate the nature of dark energy by probing the expansion history of the Universe. Using the revised SALT2 surface on public data from the first three years of the Dark Energy Survey Supernova Program (combined with an external low-$z$ SNe Ia sample) and combining with cosmic microwave background constraints, we find a change in the dark energy equation of state parameter, $\Delta w = 0.015 \pm 0.004$. This result highlights the continued importance of controlling and reducing systematic uncertainties, particularly with the next generation of supernova analyses aiming to improve constraints on dark energy properties.


title: The Effect of Thermal Pressure on Collisionless Magnetic Reconnection Rate

abstract: Modeling collisionless magnetic reconnection rate is an outstanding challenge in basic plasma physics research. While the seemingly universal rate of an order $\mathcal{O}(0.1)$ is often reported in the low-$\beta$ regime, it is not clear how reconnection rate scales with a higher plasma $\beta$. Due to the complexity of the pressure tensor, the available reconnection rate model is limited to the low plasma-$\beta$ regime, where the thermal pressure is arguably negligible. However, the thermal pressure effect becomes important when $\beta \gtrsim \mathcal{O}(1)$. Using first-principle kinetic simulations, we show that both the reconnection rate and outflow speed drop as $\beta$ gets larger. A simple analytical framework is derived to take account of the self-generated pressure anisotropy and pressure gradient in the force-balance around the diffusion region, explaining the varying trend of key quantities and reconnection rates in these simulations with different $\beta$. The predicted scaling of the normalized reconnection rate is $\simeq \mathcal{O}(0.1/\sqrt{\beta_{i0}})$ in the high $\beta$ limit, where $\beta_{i0}$ is the ion $\beta$ of the inflow plasma.


title: Self-harm: detection and support on Twitter

abstract: Since the advent of online social media platforms such as Twitter and Facebook, useful health-related studies have been conducted using the information posted by online participants. Personal health-related issues such as mental health, self-harm and depression have been studied because users often share their stories on such platforms. Online users resort to sharing because the empathy and support from online communities are crucial in helping the affected individuals. A preliminary analysis shows how contents related to non-suicidal self-injury (NSSI) proliferate on Twitter. Thus, we use Twitter to collect relevant data, analyse, and proffer ways of supporting users prone to NSSI behaviour. Our approach utilises a custom crawler to retrieve relevant tweets from self-reporting users and relevant organisations interested in combating self-harm. Through textual analysis, we identify six major categories of self-harming users consisting of inflicted, anti-self-harm, support seekers, recovered, pro-self-harm and at risk. The inflicted category dominates the collection. From an engagement perspective, we show how online users respond to the information posted by self-harm support organisations on Twitter. By noting the most engaged organisations, we apply a useful technique to uncover the organisations' strategy. The online participants show a strong inclination towards online posts associated with mental health related attributes. Our study is based on the premise that social media can be used as a tool to support proactive measures to ease the negative impact of self-harm. Consequently, we proffer ways to prevent potential users from engaging in self-harm and support affected users through a set of recommendations. To support further research, the dataset will be made available for interested researchers.


title: Preliminary Analysis of Planetary Characteristics, Dynamics, and Climates from the Systems Alliance Planetary Survey Catalogue

abstract: Just a few decades after the discovery of the Charon Relay, and the ensuing First Contact War, relatively little is known about the population of planets linked by the Prothean mass relays. Understanding the nature of these systems and how they may differ from the broader population of planetary systems in our galaxy is key to both continued human habitation across the broader Galaxy, as well as to our understanding of the Prothean civilization. What factors motivated their choices of planetary systems? Characterizing these systems allows us to peer into Prothean society and culture, and make inferences about the preferences that drove their expansion throughout the Galaxy. In this study, we undertake a broad analysis of the systems recorded in the Systems Alliance Planetary Survey, examining their dynamical stability, orbital properties, and the climates of the inhabited worlds. We find that the Alliance data is inconsistent with both a modern understanding of planetary system dynamics, as well as with our understanding of Earth-like climate dynamics. We suggest this is due in part to security-related data obfuscation by the Alliance, and in part due to the real preferences of the Protheans.


title: Qualitative Planning in Imperfect Information Games with Active Sensing and Reactive Sensor Attacks: Cost of Unawareness

abstract: We consider the probabilistic planning problem where the agent (called Player 1, or P1) can jointly plan the control actions and sensor queries in a sensor network and an attacker (called player 2, or P2) can carry out attacks on the sensors. We model such an adversarial interaction using a formal model -- a reachability game with partially controllable observation functions. The main contribution of this paper is to assess the cost of P1's unawareness: Suppose P1 misinterprets the sensor failures as probabilistic node failures due to unreliable network communication, and P2 is aware of P1's misinterpretation in addition to her partial observability. Then, from which states can P2 carry out sensor attacks to ensure, with probability one, that P1 will not be able to complete her reachability task even though, due to misinterpretation, P1 believes that she can almost-surely achieve her task. We develop an algorithm to solve the almost-sure winning sensor-attack strategy given P1's observation-based strategy. Our attack analysis could be used for attack detection in wireless communication networks and the design of provably secured attack-aware sensor allocation in decision-theoretic models for cyber-physical systems.


title: Visual Attention in Imaginative Agents

abstract: We present a recurrent agent who perceives surroundings through a series of discrete fixations. At each timestep, the agent imagines a variety of plausible scenes consistent with the fixation history. The next fixation is planned using uncertainty in the content of the imagined scenes. As time progresses, the agent becomes more certain about the content of the surrounding, and the variety in the imagined scenes reduces. The agent is built using a variational autoencoder and normalizing flows, and trained in an unsupervised manner on a proxy task of scene-reconstruction. The latent representations of the imagined scenes are found to be useful for performing pixel-level and scene-level tasks by higher-order modules. The agent is tested on various 2D and 3D datasets.


title: Adaptive Configuration of In Situ Lossy Compression for Cosmology Simulations via Fine-Grained Rate-Quality Modeling

abstract: Extreme-scale cosmological simulations have been widely used by today's researchers and scientists on leadership supercomputers. A new generation of error-bounded lossy compressors has been used in workflows to reduce storage requirements and minimize the impact of throughput limitations while saving large snapshots of high-fidelity data for post-hoc analysis. In this paper, we propose to adaptively provide compression configurations to compute partitions of cosmological simulations with newly designed post-analysis aware rate-quality modeling. The contribution is fourfold: (1) We propose a novel adaptive approach to select feasible error bounds for different partitions, showing the possibility and efficiency of adaptively configuring lossy compression for each partition individually. (2) We build models to estimate the overall loss of post-analysis result due to lossy compression and to estimate compression ratio, based on the property of each partition. (3) We develop an efficient optimization guideline to determine the best-fit configuration of error bounds combination in order to maximize the compression ratio under acceptable post-analysis quality loss. (4) Our approach introduces negligible overheads for feature extraction and error-bound optimization for each partition, enabling post-analysis-aware in situ lossy compression for cosmological simulations. Experiments show that our proposed models are highly accurate and reliable. Our fine-grained adaptive configuration approach improves the compression ratio of up to 73% on the tested datasets with the same post-analysis distortion with only 1% performance overhead.


title: Selective Feature Compression for Efficient Activity Recognition Inference

abstract: Most action recognition solutions rely on dense sampling to precisely cover the informative temporal clip. Extensively searching temporal region is expensive for a real-world application. In this work, we focus on improving the inference efficiency of current action recognition backbones on trimmed videos, and illustrate that one action model can also cover then informative region by dropping non-informative features. We present Selective Feature Compression (SFC), an action recognition inference strategy that greatly increase model inference efficiency without any accuracy compromise. Differently from previous works that compress kernel sizes and decrease the channel dimension, we propose to compress feature flow at spatio-temporal dimension without changing any backbone parameters. Our experiments on Kinetics-400, UCF101 and ActivityNet show that SFC is able to reduce inference speed by 6-7x and memory usage by 5-6x compared with the commonly used 30 crops dense sampling procedure, while also slightly improving Top1 Accuracy. We thoroughly quantitatively and qualitatively evaluate SFC and all its components and show how does SFC learn to attend to important video regions and to drop temporal features that are uninformative for the task of action recognition.


title: The $D_s$-meson leading-twist distribution amplitude within the QCD sum rules and its application to the $B_s \to D_s$ transition form factor

abstract: We make a detailed study on the $D_s$ meson leading-twist LCDA $\phi_{2;D_s}$ by using the QCD sum rules within the framework of the background field theory. To improve the precision, its moments $\langle \xi^n\rangle _{2;D_s}$ are calculated up to dimension-six condensates. At the scale $\mu = 2{\rm GeV}$, we obtain: $\langle \xi^1\rangle _{2;D_s}= -0.261^{+0.020}_{-0.020}$, $\langle \xi^2\rangle _{2;D_s} = 0.184^{+0.012}_{-0.012}$, $\langle \xi^3\rangle _{2;D_s} = -0.111 ^{+0.007}_{-0.012}$ and $\langle \xi^4\rangle _{2;D_s} = 0.075^{+0.005}_{-0.005}$. Using those moments, the $\phi_{2;D_s}$ is then constructed by using the light-cone harmonic oscillator model. As an application, we calculate the transition form factor $f^{B_s\to D_s}_+(q^2)$ within the light-cone sum rules (LCSR) approach by using a right-handed chiral current, in which the terms involving $\phi_{2;D_s}$ dominates the LCSR. It is noted that the extrapolated $f^{B_s\to D_s}_+(q^2)$ agrees with the Lattice QCD prediction. After extrapolating the transition form factor to the physically allowable $q^2$-region, we calculate the branching ratio and the CKM matrix element, which give $\mathcal{B}(\bar B_s^0 \to D_s^+ \ell\nu_\ell) = (2.03^{+0.35}_{-0.49}) \times 10^{-2}$ and $|V_{cb}|=(40.00_{-4.08}^{+4.93})\times 10^{-3}$.


title: Average-Cost Optimality Results for Borel-Space Markov Decision Processes with Universally Measurable Policies

abstract: We consider discrete-time Markov Decision Processes with Borel state and action spaces and universally measurable policies. For several long-run average cost criteria, we establish the following optimality results: the optimal average cost functions are lower semianalytic, there exist universally measurable semi-Markov or history-dependent $\epsilon$-optimal policies, and similar results hold for the minimum average costs achievable by Markov or stationary policies. We then analyze the structure of the optimal average cost functions, proving sufficient conditions for them to be constant almost everywhere with respect to certain $\sigma$-finite measures. The most important condition here is that each subset of states with positive measure be reachable with probability one under some policy. We obtain our results by exploiting an inequality for the optimal average cost functions and its connection with submartingales, and, in a special case that involves stationary policies, also by using the theory of recurrent Markov chains.


title: Studying Ad Library Integration Strategies of Top Free-to-Download Apps

abstract: In-app advertisements have become a major revenue source for app developers in the mobile app ecosystem. Ad libraries play an integral part in this ecosystem as app developers integrate these libraries into their apps to display ads. In this paper, we study ad library integration practices by analyzing 35,459 updates of 1,837 top free-to-download apps of the Google Play Store. We observe that ad libraries (e.g., Google AdMob) are not always used for serving ads -- 22.5% of the apps that integrate Google AdMob do not display ads. They instead depend on Google AdMob for analytical purposes. Among the apps that display ads, we observe that 57.9% of them integrate multiple ad libraries. We observe that such integration of multiple ad libraries occurs commonly in apps with a large number of downloads and ones in app categories with a high proportion of ad-displaying apps. We manually analyze a sample of apps and derive a set of rules to automatically identify four common strategies for integrating multiple ad libraries. Our analysis of the apps across the identified strategies shows that app developers prefer to manage their own integrations instead of using off-the-shelf features of ad libraries for integrating multiple ad libraries. Our findings are valuable for ad library developers who wish to learn first hand about the challenges of integrating ad libraries.


title: Evaporation of black holes in flat space entangled with an auxiliary universe

abstract: We study a thermofield double type entangled state on two disjoint universes $A$ and $B$, where one of the universes is asymptotically flat containing a black hole. As we increase the entanglement temperature, this black hole receives back-reaction from the stress energy tensor of the state. This results in lengthening of the wormhole region in the black hole interior, and decreasing of its horizon area, both of which are key features of an evaporating black hole. We then compute the entanglement entropy on the universe $A$ through the island formula, and argue that it naturally follows the Page curve of an evaporating black hole in flat space. We also study the effects of local operations in the gravitating universe with the black hole. We find that they accelerate the evaporation of the black hole, therefore disrupt the entanglement between two universes. Furthermore, we observe that depending on whether the operation can be regarded as an LOCC or not, the behavior of the entanglement entropy changes. In particular, when the operation is made neither in the entanglement wedge of the radiation system or that of the black hole, the transition between the island phase and the no-island phase can happen multiple times.


title: Local $L^2$-bounded commuting projections in FEEC

abstract: We construct local projections into canonical finite element spaces that appear in the finite element exterior calculus. These projections are bounded in $L^2$ and commute with the exterior derivative.


title: Less is More: Accelerating Faster Neural Networks Straight from JPEG

abstract: Most image data available are often stored in a compressed format, from which JPEG is the most widespread. To feed this data on a convolutional neural network (CNN), a preliminary decoding process is required to obtain RGB pixels, demanding a high computational load and memory usage. For this reason, the design of CNNs for processing JPEG compressed data has gained attention in recent years. In most existing works, typical CNN architectures are adapted to facilitate the learning with the DCT coefficients rather than RGB pixels. Although they are effective, their architectural changes either raise the computational costs or neglect relevant information from DCT inputs. In this paper, we examine different ways of speeding up CNNs designed for DCT inputs, exploiting learning strategies to reduce the computational complexity by taking full advantage of DCT inputs. Our experiments were conducted on the ImageNet dataset. Results show that learning how to combine all DCT inputs in a data-driven fashion is better than discarding them by hand, and its combination with a reduction of layers has proven to be effective for reducing the computational costs while retaining accuracy.


title: Sub-GMN: The Neural Subgraph Matching Network Model

abstract: As one of the most fundamental tasks in graph theory, subgraph matching is a crucial task in many fields, ranging from information retrieval, computer vision, biology, chemistry and natural language processing. Yet subgraph matching problem remains to be an NP-complete problem. This study proposes an end-to-end learning-based approximate method for subgraph matching task, called subgraph matching network (Sub-GMN). The proposed Sub-GMN firstly uses graph representation learning to map nodes to node-level embedding. It then combines metric learning and attention mechanisms to model the relationship between matched nodes in the data graph and query graph. To test the performance of the proposed method, we applied our method on two databases. We used two existing methods, GNN and FGNN as baseline for comparison. Our experiment shows that, on dataset 1, on average the accuracy of Sub-GMN are 12.21\% and 3.2\% higher than that of GNN and FGNN respectively. On average running time Sub-GMN runs 20-40 times faster than FGNN. In addition, the average F1-score of Sub-GMN on all experiments with dataset 2 reached 0.95, which demonstrates that Sub-GMN outputs more correct node-to-node matches. Comparing with the previous GNNs-based methods for subgraph matching task, our proposed Sub-GMN allows varying query and data graphes in the test/application stage, while most previous GNNs-based methods can only find a matched subgraph in the data graph during the test/application for the same query graph used in the training stage. Another advantage of our proposed Sub-GMN is that it can output a list of node-to-node matches, while most existing end-to-end GNNs based methods cannot provide the matched node pairs.


title: Convergence of group actions in metric measure geometry

abstract: We generalize the box and observable distances to those between metric measure spaces with group actions, and prove some fundamental properties. As an application, we obtain an example of a sequence of lens spaces with unbounded dimension converging to the cone of the infinite-dimensional complex projective space. Our idea is to use the theory of mass-transport.


title: Piezoelectric metastructures for simultaneous broadband energy harvesting and vibration suppression of traveling waves

abstract: In this paper, we explore an electromechanical metastructure consisting of a periodic array of piezoelectric bimorphs with resistive-inductive loads for simultaneous harvesting and attenuation of traveling wave energy. We develop fully coupled analytical models, i.e., an electroelastic transfer matrix method, and exploit both locally-resonant and Bragg band gaps to achieve a multifunctional metastructure which is capable for maximum energy conversion and vibration mitigation in a broadband fashion. Our analytical and numerical results show that the proposed metastructure can achieve energy harvesting efficiency up to 95% at the local resonance frequency of 3.18 kHz, while reaching about 51% at 5.8 kHz near the upper limit of the Bragg band gap. The broadband vibration mitigation performance based on 50% power attenuation is predicted as 1.8 kHz and 1.1 kHz in the vicinity of the band gaps. The theoretical frameworks and the applicability of the proposed metastructure are validated using a full-scale experimental setup.


title: Dealing with CSI Compression to Reduce Losses and Overhead: An Artificial Intelligence Approach

abstract: Motivated by the issue of inaccurate channel state information (CSI) at the base station (BS), which is commonly due to feedback/processing delays and compression problems, in this paper, we introduce a scalable idea of adopting artificial intelligence (AI) aided CSI acquisition. The proposed scheme enhances the CSI compression, which is done at the mobile terminal (MT), along with accurate recovery of estimated CSI at the BS. Simulation-based results corroborate the validity of the proposed scheme. Numerically, nearly 100\% recovery of the estimated CSI is observed with relatively lower overhead than the benchmark scheme. The proposed idea can bring potential benefits in the wireless communication environment, e.g., ultra-reliable and low latency communication (URLLC), where imperfect CSI and overhead is intolerable.


title: Trajectory Tracking of Underactuated Sea Vessels With Uncertain Dynamics: An Integral Reinforcement Learning Approach

abstract: Underactuated systems like sea vessels have degrees of motion that are insufficiently matched by a set of independent actuation forces. In addition, the underlying trajectory-tracking control problems grow in complexity in order to decide the optimal rudder and thrust control signals. This enforces several difficult-to-solve constraints that are associated with the error dynamical equations using classical optimal tracking and adaptive control approaches. An online machine learning mechanism based on integral reinforcement learning is proposed to find a solution for a class of nonlinear tracking problems with partial prior knowledge of the system dynamics. The actuation forces are decided using innovative forms of temporal difference equations relevant to the vessel's surge and angular velocities. The solution is implemented using an online value iteration process which is realized by employing means of the adaptive critics and gradient descent approaches. The adaptive learning mechanism exhibited well-functioning and interactive features in react to different desired reference-tracking scenarios.


title: Full-Duplex mmWave Massive MIMO Systems: A Joint Hybrid Precoding/Combining and Self-Interference Cancellation Design

abstract: Millimeter-wave (mmWave) massive multiple-input multiple-output (MIMO) systems have been considered as one of the primary candidates for the fifth generation (5G) and beyond 5G wireless communication networks to satisfy the ever-increasing capacity demands. Full-duplex technology can further enhance the advantages of mmWave massive MIMO systems. However, strong self-interference (SI) is the major limiting factor in full-duplex technology. Hence, this paper proposes a novel angular-based joint hybrid precoding/combining (AB-JHPC) technique for the full-duplex mmWave massive-MIMO systems. Our primary goals are listed as: (i) improving the self-interference cancellation (SIC), (ii) increasing the intended signal power, (iii) decreasing the channel estimation overhead, (iv) designing the massive MIMO systems with a low number of RF chains. First, the RF-stage of AB-JHPC is developed via slow time-varying angle-of-departure (AoD) and angle-of-arrival (AoA) information. A joint transmit/receive RF beamformer design is proposed for covering (excluding) the AoD/AoA support of intended (SI) channel. Second, the BB-stage of AB-JHPC is constructed via the reduced-size effective intended channel. After using the well-known singular value decomposition(SVD) approach at the BB-stage, we also propose a new semi-blind minimum mean square error (S-MMSE) technique to further suppress the residual SI power by using AoD/AoA parameters. The numerical results demonstrate that the SI signal is remarkably canceled via the proposed AB-JHPC technique. It is shown that AB-JHPC achieves 85.7 dB SIC and the total amount of SIC almost linearly increases via antenna isolation techniques. We observe that the proposed full-duplex mmWave massive MIMO systems double the achievable rate capacity compared to its half-duplex counterpart as the antenna array size increases and the transmit/receive antenna isolation improves.


title: An Energy-Efficient Quad-Camera Visual System for Autonomous Machines on FPGA Platform

abstract: In our past few years' of commercial deployment experiences, we identify localization as a critical task in autonomous machine applications, and a great acceleration target. In this paper, based on the observation that the visual frontend is a major performance and energy consumption bottleneck, we present our design and implementation of an energy-efficient hardware architecture for ORB (Oriented-Fast and Rotated- BRIEF) based localization system on FPGAs. To support our multi-sensor autonomous machine localization system, we present hardware synchronization, frame-multiplexing, and parallelization techniques, which are integrated in our design. Compared to Nvidia TX1 and Intel i7, our FPGA-based implementation achieves 5.6x and 3.4x speedup, as well as 3.0x and 34.6x power reduction, respectively.


title: Takeover, fixation and identifiability in finite neutral genealogy models

abstract: For neutral genealogy models in a finite, possibly non-constant population, there is a convenient ordered rearrangement of the particles, known as the lookdown representation, that greatly simplifies the analysis of the family trees. By introducing the dual notions of forward and backward neutrality, we give a more intuitive implementation of this rearrangement. We also show that the lookdown arranges subtrees in size-biased order of the number of their descendants, a property that is familiar in other settings but appears not to have been previously established in this context. In addition, we use the lookdown to study three properties of finite neutral models, as a function of the sequence of unlabelled litter sizes of the model: uniqueness of the infinite path (fixation), existence of a single lineage to which almost all individuals can trace their ancestry (takeover) and whether or not we can infer the lookdown rearrangement by examining the unlabelled genealogy model (identifiability). Identifiability of the spine path in size-biased Galton-Watson trees was previously studied, so we also discuss connections to those results, by relating the spinal decomposition to the lookdown.


title: TransMOT: Spatial-Temporal Graph Transformer for Multiple Object Tracking

abstract: Tracking multiple objects in videos relies on modeling the spatial-temporal interactions of the objects. In this paper, we propose a solution named TransMOT, which leverages powerful graph transformers to efficiently model the spatial and temporal interactions among the objects. TransMOT effectively models the interactions of a large number of objects by arranging the trajectories of the tracked objects as a set of sparse weighted graphs, and constructing a spatial graph transformer encoder layer, a temporal transformer encoder layer, and a spatial graph transformer decoder layer based on the graphs. TransMOT is not only more computationally efficient than the traditional Transformer, but it also achieves better tracking accuracy. To further improve the tracking speed and accuracy, we propose a cascade association framework to handle low-score detections and long-term occlusions that require large computational resources to model in TransMOT. The proposed method is evaluated on multiple benchmark datasets including MOT15, MOT16, MOT17, and MOT20, and it achieves state-of-the-art performance on all the datasets.


title: Fermion localization in braneworld teleparallel f(T,B) gravity

abstract: We study a spin 1/2 fermion in a thick braneworld in the context of teleparallel $f(T, B)$ gravity. Here, $f(T,B)$ is such that $f_1(T,B)=T+k_1B^{n_1}$ and $f_2(T,B)=B+k_2T^{n_2}$, where $n_{1,2}$ and $k_{1,2}$ are parameters that control the influence of torsion and the boundary term. We assume Yukawa coupling, where one scalar field is coupled to a Dirac spinor field. We show how the $n_{1,2}$ and $k_{1,2}$ parameters control the width of the massless Kaluza-Klein mode, the breadth of non-normalized massive fermionic modes, and the properties of the analogue quantum-potential near the origin.


title: Modular Tree Network for Source Code Representation Learning

abstract: Learning representation for source code is a foundation of many program analysis tasks. In recent years, neural networks have already shown success in this area, but most existing models did not make full use of the unique structural information of programs. Although abstract syntax tree-based neural models can handle the tree structure in the source code, they cannot capture the richness of different types of substructure in programs. In this paper, we propose a modular tree network (MTN) which dynamically composes different neural network units into tree structures based on the input abstract syntax tree. Different from previous tree-structural neural network models, MTN can capture the semantic differences between types of ASTsubstructures. We evaluate our model on two tasks: program classification and code clone detection. Ourmodel achieves the best performance compared with state-of-the-art approaches in both tasks, showing the advantage of leveraging more elaborate structure information of the source code.


title: Vanishing theorems and adjoint linear systems on normal surfaces in positive characteristic

abstract: We prove the Kawamata-Viehweg vanishing theorem for a large class of divisors on surfaces in positive characteristic. By using this vanishing theorem, Reider-type theorems and extension theorems of morphisms for normal surfaces are established. As an application of the extension theorems, we characterize non-singular rational points on any plane curve over an arbitrary base field in terms of rational functions on the curve.


title: True Random Number Generation using Latency Variations of Commercial MRAM Chips

abstract: The emerging magneto-resistive RAM (MRAM) has considerable potential to become a universal memory technology because of its several advantages: unlimited endurance, lower read/write latency, ultralow-power operation, high-density, and CMOS compatibility, etc. This paper will demonstrate an effective technique to generate random numbers from energy-efficient consumer-off-the-shelf (COTS) MRAM chips. In the proposed scheme, the inherent (intrinsic/extrinsic process variation) stochastic switching behavior of magnetic tunnel junctions (MTJs) is exploited by manipulating the write latency of COTS MRAM chips. This is the first system-level experimental implementation of true random number generator (TRNG) using COTS toggle MRAM technology to the best of our knowledge. The experimental results and subsequent NIST SP-800-22 suite test reveal that the proposed latency-based TRNG is acceptably fast (~22 Mbit/s in the worst case) and robust over a wide range of operating conditions.


title: Data-Driven Optimized Tracking Control Heuristic for MIMO Structures: A Balance System Case Study

abstract: A data-driven computational heuristic is proposed to control MIMO systems without prior knowledge of their dynamics. The heuristic is illustrated on a two-input two-output balance system. It integrates a self-adjusting nonlinear threshold accepting heuristic with a neural network to compromise between the desired transient and steady state characteristics of the system while optimizing a dynamic cost function. The heuristic decides on the control gains of multiple interacting PID control loops. The neural network is trained upon optimizing a weighted-derivative like objective cost function. The performance of the developed mechanism is compared with another controller that employs a combined PID-Riccati approach. One of the salient features of the proposed control schemes is that they do not require prior knowledge of the system dynamics. However, they depend on a known region of stability for the control gains to be used as a search space by the optimization algorithm. The control mechanism is validated using different optimization criteria which address different design requirements.


title: A Novel Algorithm to Report CSI in MIMO-Based Wireless Networks

abstract: In wireless communication, accurate channel state information (CSI) is of pivotal importance. In practice, due to processing and feedback delays, estimated CSI can be outdated, which can severely deteriorate the performance of the communication system. Besides, to feedback estimated CSI, a strong compression of the CSI, evaluated at the user equipment (UE), is performed to reduce the over-the-air (OTA) overhead. Such compression strongly reduces the precision of the estimated CSI, which ultimately impacts the performance of multiple-input multiple-output (MIMO) precoding. Motivated by such issues, we present a novel scalable idea of reporting CSI in wireless networks, which is applicable to both time-division duplex (TDD) and frequency-division duplex (FDD) systems. In particular, the novel approach introduces the use of a channel predictor function, e.g., Kalman filter (KF), at both ends of the communication system to predict CSI. Simulation-based results demonstrate that the novel approach reduces not only the channel mean-squared-error (MSE) but also the OTA overhead to feedback the estimated CSI when there is immense variation in the mobile radio channel. Besides, in the immobile radio channel, feedback can be eliminated, which brings the benefit of further reducing the OTA overhead. Additionally, the proposed method provides a significant signal-to-noise ratio (SNR) gain in both the channel conditions, i.e., highly mobile and immobile.


title: Graph-Based Intercategory and Intermodality Network for Multilabel Classification and Melanoma Diagnosis of Skin Lesions in Dermoscopy and Clinical Images

abstract: The identification of melanoma involves an integrated analysis of skin lesion images acquired using the clinical and dermoscopy modalities. Dermoscopic images provide a detailed view of the subsurface visual structures that supplement the macroscopic clinical images. Melanoma diagnosis is commonly based on the 7-point visual category checklist (7PC). The 7PC contains intrinsic relationships between categories that can aid classification, such as shared features, correlations, and the contributions of categories towards diagnosis. Manual classification is subjective and prone to intra- and interobserver variability. This presents an opportunity for automated methods to improve diagnosis. Current state-of-the-art methods focus on a single image modality and ignore information from the other, or do not fully leverage the complementary information from both modalities. Further, there is not a method to exploit the intercategory relationships in the 7PC. In this study, we address these issues by proposing a graph-based intercategory and intermodality network (GIIN) with two modules. A graph-based relational module (GRM) leverages intercategorical relations, intermodal relations, and prioritises the visual structure details from dermoscopy by encoding category representations in a graph network. The category embedding learning module (CELM) captures representations that are specialised for each category and support the GRM. We show that our modules are effective at enhancing classification performance using a public dataset of dermoscopy-clinical images, and show that our method outperforms the state-of-the-art at classifying the 7PC categories and diagnosis.


title: Unsupervised Person Re-identification via Simultaneous Clustering and Consistency Learning

abstract: Unsupervised person re-identification (re-ID) has become an important topic due to its potential to resolve the scalability problem of supervised re-ID models. However, existing methods simply utilize pseudo labels from clustering for supervision and thus have not yet fully explored the semantic information in data itself, which limits representation capabilities of learned models. To address this problem, we design a pretext task for unsupervised re-ID by learning visual consistency from still images and temporal consistency during training process, such that the clustering network can separate the images into semantic clusters automatically. Specifically, the pretext task learns semantically meaningful representations by maximizing the agreement between two encoded views of the same image via a consistency loss in latent space. Meanwhile, we optimize the model by grouping the two encoded views into same cluster, thus enhancing the visual consistency between views. Experiments on Market-1501, DukeMTMC-reID and MSMT17 datasets demonstrate that our proposed approach outperforms the state-of-the-art methods by large margins.


title: AdaPool: A Diurnal-Adaptive Fleet Management Framework using Model-Free Deep Reinforcement Learning and Change Point Detection

abstract: This paper introduces an adaptive model-free deep reinforcement approach that can recognize and adapt to the diurnal patterns in the ride-sharing environment with car-pooling. Deep Reinforcement Learning (RL) suffers from catastrophic forgetting due to being agnostic to the timescale of changes in the distribution of experiences. Although RL algorithms are guaranteed to converge to optimal policies in Markov decision processes (MDPs), this only holds in the presence of static environments. However, this assumption is very restrictive. In many real-world problems like ride-sharing, traffic control, etc., we are dealing with highly dynamic environments, where RL methods yield only sub-optimal decisions. To mitigate this problem in highly dynamic environments, we (1) adopt an online Dirichlet change point detection (ODCP) algorithm to detect the changes in the distribution of experiences, (2) develop a Deep Q Network (DQN) agent that is capable of recognizing diurnal patterns and making informed dispatching decisions according to the changes in the underlying environment. Rather than fixing patterns by time of week, the proposed approach automatically detects that the MDP has changed, and uses the results of the new model. In addition to the adaptation logic in dispatching, this paper also proposes a dynamic, demand-aware vehicle-passenger matching and route planning framework that dynamically generates optimal routes for each vehicle based on online demand, vehicle capacities, and locations. Evaluation on New York City Taxi public dataset shows the effectiveness of our approach in improving the fleet utilization, where less than 50% of the fleet are utilized to serve the demand of up to 90% of the requests, while maximizing profits and minimizing idle times.


title: Mitigating the Impacts of Uncertain Geomagnetic Disturbances on Electric Grids: A Distributionally Robust Optimization Approach

abstract: Severe geomagnetic disturbances (GMDs) increase the magnitude of the electric field on the Earth's surface (E-field) and drive geomagnetically-induced currents (GICs) along the transmission lines in electric grids. These additional currents can pose severe risks, such as current distortions, transformer saturation and increased reactive power losses, each of which can lead to system unreliability. Several mitigation actions (e.g., changing grid topology) exist that can reduce the harmful GIC effects on the grids. Making such decisions can be challenging, however, because the magnitude and direction of the E-field are uncertain and non-stationary. In this paper, we model uncertain E-fields using the distributionally robust optimization (DRO) approach that determines optimal transmission grid operations such that the worst-case expectation of the system cost is minimized. We also capture the effect of GICs on the nonlinear AC power flow equations. For solution approaches, we develop an accelerated column-and-constraint generation (CCG) algorithm by exploiting a special structure of the support set of uncertain parameters representing the E-field. Extensive numerical experiments based on "epri-21" and "uiuc-150" systems, designed for GMD studies, demonstrate (i) the computational performance of the accelerated CCG algorithm, (ii) the superior performance of distributionally robust grid operations that satisfy nonlinear, nonconvex AC power flow equations and GIC constraints, in comparison with standard stochastic programming-based methods during the out-of-sample testing.


title: Fusing RGBD Tracking and Segmentation Tree Sampling for Multi-Hypothesis Volumetric Segmentation

abstract: Despite rapid progress in scene segmentation in recent years, 3D segmentation methods are still limited when there is severe occlusion. The key challenge is estimating the segment boundaries of (partially) occluded objects, which are inherently ambiguous when considering only a single frame. In this work, we propose Multihypothesis Segmentation Tracking (MST), a novel method for volumetric segmentation in changing scenes, which allows scene ambiguity to be tracked and our estimates to be adjusted over time as we interact with the scene. Two main innovations allow us to tackle this difficult problem: 1) A novel way to sample possible segmentations from a segmentation tree; and 2) A novel approach to fusing tracking results with multiple segmentation estimates. These methods allow MST to track the segmentation state over time and incorporate new information, such as new objects being revealed. We evaluate our method on several cluttered tabletop environments in simulation and reality. Our results show that MST outperforms baselines in all tested scenes.


title: Rate-Splitting Multiple Access for Multigroup Multicast Cellular and Satellite Communications: PHY Layer Design and Link-Level Simulations

abstract: Rate-splitting multiple access (RSMA), relying on linearly precoded rate-splitting (RS) at the transmitter and successive interference cancellation (SIC) at the receivers has emerged as a powerful and flexible multiple access strategy for downlink multi-user multi-antenna systems. Through message splitting and the transmission of both common and private messages, RSMA has been demonstrated to be a robust interference management strategy which enables partially decoding interference and partially treating interference as noise. In this work, we consider the application of RSMA in a multigroup multicast scenario, where each message is intended to a group of users. By leveraging the recent results on the max-min fair (MMF) optimization problem of RSMA-based multigroup multicast beamforming with imperfect channel state information at the transmitter (CSIT), we investigate the design of the physical (PHY) layer including finite length polar coding, finite alphabet modulation, adaptive modulation and coding (AMC) algorithm, and SIC receivers, etc. Link-level simulation (LLS) results verify the superiority of RSMA-based multigroup multicast transmission compared with space-division multiple access (SDMA)-based strategy in both cellular systems and multibeam satellite systems.


title: The $k$-Colorable Unit Disk Cover Problem

abstract: In this article, we consider colorable variations of the Unit Disk Cover ({\it UDC}) problem as follows. {\it $k$-Colorable Discrete Unit Disk Cover ({\it $k$-CDUDC})}: Given a set $P$ of $n$ points, and a set $D$ of $m$ unit disks (of radius=1), both lying in the plane, and a parameter $k$, the objective is to compute a set $D'\subseteq D$ such that every point in $P$ is covered by at least one disk in $D'$ and there exists a function $\chi:D'\rightarrow C$ that assigns colors to disks in $D'$ such that for any $d$ and $d'$ in $D'$ if $d\cap d'\neq\emptyset$, then $\chi(d)\neq\chi(d')$, where $C$ denotes a set containing $k$ distinct colors. For the {\it $k$-CDUDC} problem, our proposed algorithms approximate the number of colors used in the coloring if there exists a $k$-colorable cover. We first propose a 4-approximation algorithm in $O(m^{7k}n\log k)$ time for this problem and then show that the running time can be improved by a multiplicative factor of $m^k$, where a positive integer $k$ denotes the cardinality of a color-set. The previous best known result for the problem when $k=3$ is due to the recent work of Biedl et al., (2021), who proposed a 2-approximation algorithm in $O(m^{25}n)$ time. For $k=3$, our algorithm runs in $O(m^{18}n)$ time, faster than the previous best algorithm, but gives a 4-approximate result. We then generalize our approach to exhibit a $O((1+\lceil\frac{2}{\tau}\rceil)^2)$-approximation algorithm in $O(m^{(\lfloor\frac{4\pi+8\tau+\tau^2}{\sqrt{12}}\rfloor)k}n\log k)$ time for a given $1 \leq \tau \leq 2$. We also extend our algorithm to solve the {\it $k$-Colorable Line Segment Disk Cover ({\it $k$-CLSDC})} and {\it $k$-Colorable Rectangular Region Cover ({\it $k$-CRRC})} problems, in which instead of the set $P$ of $n$ points, we are given a set $S$ of $n$ line segments, and a rectangular region $\cal R$, respectively.


title: Parameterization of nearshore wave breaker index

abstract: The performances of phase-averaged parametric nearshore wave transformation models depend significantly on a reliable estimate of the wave breaker index r (the breaker height-to-depth ratio), a free model parameter that essentially controls the amount of breaking energy dissipation. While the previous studies have suggested separate relationships between r and the offshore wave steepness (s0) or the normalized local water depth (kh), the parameterization of r still requires further investigation considering a wider variety of conditions and a sounder physical basis. In this study, we use the field datasets of wave height and the inverse modelling approach to reveal a composite dependence of r on both s0 and kh. Specifically, the results show a positive dependence of r on kh for larger s0, and a negative dependence of r on kh for smaller s0. Based on such composite relationships, a new r formula is proposed, and its performance is verified against the available datasets of wave height in three coasts and 14 laboratory tests. Implementation of this new formula in a parametric wave model leads to the error reduction of wave height prediction by 10~24% (mean = 19%) relative to seven widely used models in literatures. In particular, a remarkably higher model accuracy is obtained under wave conditions with small offshore wave steepness, which is important for studying onshore sediment transport and beach recovery. Two counteractive physical mechanisms for wave nonlinearity effects, namely the breaking intensification mechanism and the breaking resistance mechanism, are suggested to explain the opposite r-kh relationships within different ranges of s0.


title: Modified scattering for a dispersion-managed nonlinear Schr\"odinger equation

abstract: We prove sharp $L^\infty$ decay and modified scattering for a one-dimensional dispersion-managed cubic nonlinear Schr\"odinger equation with small initial data chosen from a weighted Sobolev space. Specifically, we work with an averaged version of the dispersion-managed NLS in the strong dispersion management regime. The proof adapts techniques from Hayashi-Naumkin and Kato-Pusateri, which established small-data modified scattering for the standard $1d$ cubic NLS.


title: Training Multi-bit Quantized and Binarized Networks with A Learnable Symmetric Quantizer

abstract: Quantizing weights and activations of deep neural networks is essential for deploying them in resource-constrained devices, or cloud platforms for at-scale services. While binarization is a special case of quantization, this extreme case often leads to several training difficulties, and necessitates specialized models and training methods. As a result, recent quantization methods do not provide binarization, thus losing the most resource-efficient option, and quantized and binarized networks have been distinct research areas. We examine binarization difficulties in a quantization framework and find that all we need to enable the binary training are a symmetric quantizer, good initialization, and careful hyperparameter selection. These techniques also lead to substantial improvements in multi-bit quantization. We demonstrate our unified quantization framework, denoted as UniQ, on the ImageNet dataset with various architectures such as ResNet-18,-34 and MobileNetV2. For multi-bit quantization, UniQ outperforms existing methods to achieve the state-of-the-art accuracy. In binarization, the achieved accuracy is comparable to existing state-of-the-art methods even without modifying the original architectures.


title: Multiparameter quantum metrology using strongly interacting spin systems

abstract: Interacting quantum systems are attracting increasing interest for developing precise metrology. In particular, the realisation that quantum-correlated states and the dynamics of interacting systems can lead to entirely new and unexpected phenomena have initiated an intense research effort to explore interaction-based metrology both theoretically and experimentally. However, the current framework of interaction-based metrology mainly focuses on single-parameter estimations, a demonstration of multiparameter metrology using interactions as a resource was heretofore lacking. Here we demonstrate an interaction-based multiparameter metrology with strongly interacting nuclear spins. We show that the interacting spins become intrinsically sensitive to all components of a multidimensional field when their interactions are significantly larger than their Larmor frequencies. Using liquid-state molecules containing strongly interacting nuclear spins, we demonstrate the proof-of-principle estimation of all three components of an unknown magnetic field and inertial rotation. In contrast to existing approaches, the present interaction-based multiparameter sensing does not require external reference fields and opens a path to develop an entirely new class of multiparameter quantum sensors.


title: Blow-up phenomena in a parabolic-elliptic-elliptic attraction-repulsion chemotaxis system with superlinear logistic degradation

abstract: This paper is concerned with the attraction-repulsion chemotaxis system with superlinear logistic degradation, \begin{align*} \begin{cases} u_t = \Delta u - \chi \nabla\cdot(u \nabla v) + \xi \nabla\cdot (u \nabla w) + \lambda u - \mu u^k, \quad &x \in \Omega,\ t>0,\\[1.05mm] 0= \Delta v + \alpha u - \beta v, \quad &x \in \Omega,\ t>0,\\[1.05mm] 0= \Delta w + \gamma u - \delta w, \quad &x \in \Omega,\ t>0, \end{cases} \end{align*} under homogeneous Neumann boundary conditions, in a ball $\Omega \subset \mathbb{R}^n$ ($n \ge 3$), with constant parameters $\lambda \in \mathbb{R}$, $k>1$, $\mu, \chi, \xi, \alpha, \beta, \gamma, \delta>0$. Blow-up phenomena in the system have been well investigated in the case $\lambda=\mu=0$, whereas the attraction-repulsion chemotaxis system with logistic degradation has been not studied. Under the condition that $k>1$ is close to $1$, this paper ensures a solution which blows up in $L^\infty$-norm and $L^\sigma$-norm with some $\sigma>1$ for some nonnegative initial data. Moreover, a lower bound of blow-up time is derived.


title: Intrusive and non-intrusive reduced order modeling of the rotating thermal shallow water equation

abstract: In this paper, we investigate projection-based intrusive and data-driven non-intrusive model order reduction methods in numerical simulation of rotating thermal shallow water equation (RTSWE) in parametric and non-parametric form. Discretization of the RTSWE in space with centered finite differences leads to Hamiltonian system of ordinary differential equations with linear and quadratic terms. The full-order model (FOM) is obtained by applying linearly implicit Kahan's method in time. Applying proper orthogonal decomposition with Galerkin projection (POD-G), we construct the intrusive reduced-order model (ROM). We apply operator inference (OpInf) with re-projection for non-intrusive reduced-order modeling. In the parametric case, we make use of the parameter dependency at the level of the PDE without interpolating between the reduced operators. The least-squares problem of the OpInf is regularized with the minimum norm solution. Both ROMs behave similar and are able to accurately predict the test and training data and capture system behavior in the prediction phase with several orders of computational speedup over the FOM. The preservation of system physics such as the conserved quantities of the RTSWE by both ROMs enables that the models fit better to data and stable solutions are obtained in long-term predictions, which are robust to parameter changes.


title: Van der Waals phonon polariton microstructures for configurable infrared electromagnetic field localizations

abstract: Polar van der Waals (vdW) crystals that support phonon polaritons have recently attracted much attention because they can confine infrared and terahertz (THz) light to deeply subwavelength dimensions, allowing for the guiding and manipulation of light at the nanoscale. The practical applications of these crystals in devices rely strongly on deterministic engineering of their spatially localized electromagnetic field distributions, which has remained challenging. This study demonstrates that polariton interference can be enhanced and tailored by patterning the vdW crystal {\alpha}-MoO3 into microstructures that support highly in-plane anisotropic phonon polaritons. The orientation of the polaritonic in-plane isofrequency curve relative to the microstructure edges is a critical parameter governing the polariton interference, rendering the configuration of infrared electromagnetic field localizations by enabling the tuning of the microstructure size and shape and the excitation frequency. Thus, our study presents an effective rationale for engineering infrared light flow in planar photonic devices.


title: Ihara zeta function and twisted Alexander invariants

abstract: Lin and Wang defined a model of random walks on knot diagrams and interprete the Alexnader polynomials and the colored Jones polynomials as Ihara zeta functions, i.e. zeta functions defined by counting cycles on the knot diagram. Using this explanation, they gave a more conceptual proof for the Melvin-Morton conjecture. In this paper, we give an analogous zeta function expression for the twisted Alexander invariants.


title: On the difference between a D. H. Lehmer number and its inverse over short interval

abstract: Let $q>2$ be an odd integer. For each integer $x$ with $0<x<q$ and $(q,x)= 1$, we know that there exists one and only one $\bar{x}$ with $0<\bar{x}<q$ such that $x\bar{x}\equiv1(\bmod q)$. A Lehmer number is defined to be any integer $a$ with $2\dagger(a+\bar{a})$. For any nonnegative integer $k$, Let $$ M(x,q,k)=\displaystyle\mathop {\displaystyle\mathop{\sum{'}}_{a=1}^{q} \displaystyle\mathop{\sum{'}}_{b\leq xq}}_{\mbox{$\tiny\begin{array}{c} 2|a+b+1\\ ab\equiv1(\bmod q)\end{array}$}}(a-b)^{2k}.$$ The main purpose of this paper is to study the properties of $M(x,q,k)$, and give a sharp asymptotic formula, by using estimates of Kloosterman's sums and properties of trigonometric sums.


title: Radar Human Motion Classification Using Multi-Antenna System

abstract: This paper considers human activity classification for an indoor radar system. Human motions generate nonstationary radar returns which represent Doppler and micro-Doppler signals. The time-frequency (TF) analysis of micro-Doppler signals can discern subtle variations on the motion by precisely revealing velocity components of various moving body parts. We consider radar for activity monitoring using TF-based machine learning approach exploiting both temporal and spatial degrees of freedom. The proposed approach captures different human motion representations more vividly in joint-variable data domains achieved through beamforming at the receiver. The radar data is collected using real time measurements at 77 GHz using four receive antennas, and subsequently micro-Doppler signatures are analyzed through machine learning algorithm for classifications of human walking motions. We present the performance of the proposed multi antenna approach in separating and classifying two closely walking persons moving in opposite directions.


title: Integrating Subgraph-aware Relation and DirectionReasoning for Question Answering

abstract: Question Answering (QA) models over Knowledge Bases (KBs) are capable of providing more precise answers by utilizing relation information among entities. Although effective, most of these models solely rely on fixed relation representations to obtain answers for different question-related KB subgraphs. Hence, the rich structured information of these subgraphs may be overlooked by the relation representation vectors. Meanwhile, the direction information of reasoning, which has been proven effective for the answer prediction on graphs, has not been fully explored in existing work. To address these challenges, we propose a novel neural model, Relation-updated Direction-guided Answer Selector (RDAS), which converts relations in each subgraph to additional nodes to learn structure information. Additionally, we utilize direction information to enhance the reasoning ability. Experimental results show that our model yields substantial improvements on two widely used datasets.


title: Fast Jacobian-Vector Product for Deep Networks

abstract: Jacobian-vector products (JVPs) form the backbone of many recent developments in Deep Networks (DNs), with applications including faster constrained optimization, regularization with generalization guarantees, and adversarial example sensitivity assessments. Unfortunately, JVPs are computationally expensive for real world DN architectures and require the use of automatic differentiation to avoid manually adapting the JVP program when changing the DN architecture. We propose a novel method to quickly compute JVPs for any DN that employ Continuous Piecewise Affine (e.g., leaky-ReLU, max-pooling, maxout, etc.) nonlinearities. We show that our technique is on average $2\times$ faster than the fastest alternative over $13$ DN architectures and across various hardware. In addition, our solution does not require automatic differentiation and is thus easy to deploy in software, requiring only the modification of a few lines of codes that do not depend on the DN architecture.


title: Rate-Splitting Multiple Access for Multi-Antenna Broadcast Channels with Statistical CSIT

abstract: Rate-splitting multiple access (RSMA) is a promising technique for downlink multi-antenna communications owning to its capability of enhancing the system performance in a wide range of network loads, user deployments and channel state information at the transmitter (CSIT) inaccuracies. In this paper, we investigate the achievable rate performance of RSMA in a multi-user multiple-input single-output (MU-MISO) network where only slow-varying statistical channel state information (CSI) is available at the transmitter. RSMA-based statistical beamforming and the split of the common stream is optimized with the objective of maximizing the minimum user rate subject to a sum power budget of the transmitter. Two statistical CSIT scenarios are investigated, namely the Rayleigh fading channels with only spatial correlations known at the transmitter, and the uniform linear array (ULA) deployment with only channel amplitudes and mean of phase known at the transmitter. Numerical results demonstrate the explicit max min fairness (MMF) rate gain of RSMA over space division multiple access (SDMA) in both scenarios. Moreover, we demonstrate that RSMA is more robust to the inaccuracy of statistical CSIT.


title: Noncommutative conics in Calabi-Yau quantum projective planes

abstract: In noncommutative algebraic geometry, noncommutative quadric hypersurfaces are major objects of study. In this paper, we focus on studying noncommutative conics $\operatorname{Proj_{nc}} A$ embedded into Calabi-Yau quantum projective planes. In particular, we give complete classifications of homogeneous coordinate algebras $A$ of noncommutative conics up to isomorphism of graded algebras, and of noncommutive conics $\operatorname{Proj_{nc}} A$ up to isomorphism of noncommutative schemes.


title: Embedded Self-Distillation in Compact Multi-Branch Ensemble Network for Remote Sensing Scene Classification

abstract: Remote sensing (RS) image scene classification task faces many challenges due to the interference from different characteristics of different geographical elements. To solve this problem, we propose a multi-branch ensemble network to enhance the feature representation ability by fusing features in final output logits and intermediate feature maps. However, simply adding branches will increase the complexity of models and decline the inference efficiency. On this issue, we embed self-distillation (SD) method to transfer knowledge from ensemble network to main-branch in it. Through optimizing with SD, main-branch will have close performance as ensemble network. During inference, we can cut other branches to simplify the whole model. In this paper, we first design compact multi-branch ensemble network, which can be trained in an end-to-end manner. Then, we insert SD method on output logits and feature maps. Compared to previous methods, our proposed architecture (ESD-MBENet) performs strongly on classification accuracy with compact design. Extensive experiments are applied on three benchmark RS datasets AID, NWPU-RESISC45 and UC-Merced with three classic baseline models, VGG16, ResNet50 and DenseNet121. Results prove that our proposed ESD-MBENet can achieve better accuracy than previous state-of-the-art (SOTA) complex models. Moreover, abundant visualization analysis make our method more convincing and interpretable.


title: Describing traveler choice behavior using the free utility model

abstract: Travel demand forecasting is an essential part of transportation planning and management. The four-step travel model is the traditional and most-common procedure utilized for travel demand forecasting, and many models have been proposed in the literature to describe each step separately. However, there is still a lack of a unified modeling framework that can successfully describe the collective choice behavior of travelers interacting with each other at different steps. This study uses the free utility model, whose objective function is mathematically consistent with the Helmholtz free energy in physics, to separately and simultaneously describe travelers' mode, destination, and route choice behaviors. The free utility model's basic assumption is that the travelers will trade off the expected utility and information-processing cost to maximize their own utility. This model provides not only a unified modeling framework for traveler choice behavior, but also provides a new perspective for understanding the user equilibrium model in transportation science and the potential game model in game theory.


title: Page curves for a family of exactly solvable evaporating black holes

abstract: We study the entanglement entropy of a one-parameter family of exactly solvable gravities in the 2-dimensional asymptotically-flat space. The islands and Page curves of eternal, evaporating and bath-removed black holes are investigated. The different theories in this parameter class are identified through field redefinitions which leave the island invariant. The Page transition is found to occur at the first a third of the black hole life time in the evaporating case for this family of solutions. In addition, we consider gluing the equilibrium black hole and the evaporating one along a null trajectory and study the effect of gluing on the islands and Page curves. In the glued space, the island jumps across two different geometries at a certain retarded time. As a result, the Page transition is stretched and split into two separate ones -- the first transition happens when the net entropy generation stops and the second one occurs as the early radiation effectively starts to become purified. Finally, we discuss the issues concerning the inconsistent rates of purification and the paradox related to the state of the radiation.


title: Active plasmon interference control on ultrafast time scales by free electrons

abstract: Interference between light waves is one of the widely known phenomena in physics, which is widely used in modern optics, ranging from precise detection at the nanoscale to gravitational-wave observation. Akin to light, both classical and quantum interferences between surface plasmon polaritons (SPPs) have been demonstrated. However, to actively control the SPP interference within subcycle in time (usually less than several femtoseconds in the visible range) is still missing, which hinders the ultimate manipulation of SPP interference on ultrafast time scale. In this paper, the interference between SPPs launched by a hole dimer, which was excited by a grazing incident free electron beam without direct contact, was manipulated through both propagation and initial phase difference control. Particularly, using cathodoluminescence spectroscopy, the appearance of higher-order interference orders was obtained through propagation phase control by increasing separation distances of the dimer. Meanwhile, the peak-valley-peak evolution at a certain wavelength through changing the accelerating voltages was observed, which originates from the initial phase difference control of hole launched SPPs. In particular, the time resolution of this kind of control is shown to be in the ultrafast attosecond (as) region. Our work suggests that fast electron beams can be an efficient tool to control polarition interference in subcycle temporal scale, which can be potentially used in ultrafast optical processing or sensing.


title: DF^2AM: Dual-level Feature Fusion and Affinity Modeling for RGB-Infrared Cross-modality Person Re-identification

abstract: RGB-infrared person re-identification is a challenging task due to the intra-class variations and cross-modality discrepancy. Existing works mainly focus on learning modality-shared global representations by aligning image styles or feature distributions across modalities, while local feature from body part and relationships between person images are largely neglected. In this paper, we propose a Dual-level (i.e., local and global) Feature Fusion (DF^2) module by learning attention for discriminative feature from local to global manner. In particular, the attention for a local feature is determined locally, i.e., applying a learned transformation function on itself. Meanwhile, to further mining the relationships between global features from person images, we propose an Affinities Modeling (AM) module to obtain the optimal intra- and inter-modality image matching. Specifically, AM employes intra-class compactness and inter-class separability in the sample similarities as supervised information to model the affinities between intra- and inter-modality samples. Experimental results show that our proposed method outperforms state-of-the-arts by large margins on two widely used cross-modality re-ID datasets SYSU-MM01 and RegDB, respectively.


title: The topological order of the space

abstract: Topological order is a new type order that beyond Landau's symmetry breaking theory. The topological entanglement entropy provides a universal quantum number to characterize the topological order in a system. The topological entanglement entropy of the BTZ black hole was calculated and found that it coincides with that for fractional quantum Hall state. So the BTZ black holes have the same topological order with the fractional quantum Hall state. We conjecture that black holes in higher dimensions also have topological orders. Next we want to study the topological order of ordinary spaces which can be described by spin network states in loop quantum gravity. We advise to bring in the methods and results in string-net condensation to loop quantum gravity to solve some difficult problems.


title: Linear polarization-direction correlations in $\gamma$-ray scattering experiments

abstract: Scattering measurements with incident linearly polarized $\gamma$ rays provide information on spins, parities, and $\gamma$-ray multipolarity mixing coefficients, and, therefore, on the nuclear matrix elements involved in the transitions. We present the general formalism for analyzing the observed angular correlations. The expressions are used to compute three-dimensional radiation patterns, which are important tools for optimizing experimental setups. Frequently, $\gamma$-ray transitions can proceed via two multipolarities that mix coherently. In such cases, the relative phases of the nuclear matrix elements are important when comparing results from different measurements. We discuss different phase conventions that have been used in the literature and present their relationships. Finally, we propose a basic experimental geometry consisting of detectors located at four different spatial locations. For this geometry, we present the measured anisotropies of the emitted $\gamma$ rays in graphical format as an aid in the data analysis.


title: Stability and error analysis of IMEX SAV schemes for the magneto-hydrodynamic equations

abstract: We construct and analyze first- and second-order implicit-explicit (IMEX) schemes based on the scalar auxiliary variable (SAV) approach for the magneto-hydrodynamic equations. These schemes are linear, only require solving a sequence of linear differential equations with constant coefficients at each time step, and are unconditionally energy stable. We derive rigorous error estimates for the velocity, pressure and magnetic field of the first-order scheme in the two dimensional case without any condition on the time step. Numerical examples are presented to validate the proposed schemes.


title: Bidirectional Multiscale Feature Aggregation for Speaker Verification

abstract: In this paper, we propose a novel bidirectional multiscale feature aggregation (BMFA) network with attentional fusion modules for text-independent speaker verification. The feature maps from different stages of the backbone network are iteratively combined and refined in both a bottom-up and top-down manner. Furthermore, instead of simple concatenation or element-wise addition of feature maps from different stages, an attentional fusion module is designed to compute the fusion weights. Experiments are conducted on the NIST SRE16 and VoxCeleb1 datasets. The experimental results demonstrate the effectiveness of the bidirectional aggregation strategy and show that the proposed attentional fusion module can further improve the performance.


title: Two-phase weakly supervised object detection with pseudo ground truth mining

abstract: Weakly Supervised Object Detection (WSOD), aiming to train detectors with only image-level dataset, has arisen increasing attention for researchers. In this project, we focus on two-phase WSOD architecture which integrates a powerful detector with a pure WSOD model. We explore the effectiveness of some representative detectors utilized as the second-phase detector in two-phase WSOD and propose a two-phase WSOD architecture. In addition, we present a strategy to establish the pseudo ground truth (PGT) used to train the second-phase detector. Unlike previous works that regard top one bounding boxes as PGT, we consider more bounding boxes to establish the PGT annotations. This alleviates the insufficient learning problem caused by the low recall of PGT. We also propose some strategies to refine the PGT during the training of the second detector. Our strategies suspend the training in specific epoch, then refine the PGT by the outputs of the second-phase detector. After that, the algorithm continues the training with the same gradients and weights as those before suspending. Elaborate experiments are conduceted on the PASCAL VOC 2007 dataset to verify the effectiveness of our methods. As results demonstrate, our two-phase architecture improves the mAP from 49.17% to 53.21% compared with the single PCL model. Additionally, the best PGT generation strategy obtains a 0.7% mAP increment. Our best refinement strategy boosts the performance by 1.74% mAP. The best results adopting all of our methods achieve 55.231% mAP which is the state-of-the-art performance.


title: Dive into Ambiguity: Latent Distribution Mining and Pairwise Uncertainty Estimation for Facial Expression Recognition

abstract: Due to the subjective annotation and the inherent interclass similarity of facial expressions, one of key challenges in Facial Expression Recognition (FER) is the annotation ambiguity. In this paper, we proposes a solution, named DMUE, to address the problem of annotation ambiguity from two perspectives: the latent Distribution Mining and the pairwise Uncertainty Estimation. For the former, an auxiliary multi-branch learning framework is introduced to better mine and describe the latent distribution in the label space. For the latter, the pairwise relationship of semantic feature between instances are fully exploited to estimate the ambiguity extent in the instance space. The proposed method is independent to the backbone architectures, and brings no extra burden for inference. The experiments are conducted on the popular real-world benchmarks and the synthetic noisy datasets. Either way, the proposed DMUE stably achieves leading performance.


title: Unsupervised Domain Expansion for Visual Categorization

abstract: Expanding visual categorization into a novel domain without the need of extra annotation has been a long-term interest for multimedia intelligence. Previously, this challenge has been approached by unsupervised domain adaptation (UDA). Given labeled data from a source domain and unlabeled data from a target domain, UDA seeks for a deep representation that is both discriminative and domain-invariant. While UDA focuses on the target domain, we argue that the performance on both source and target domains matters, as in practice which domain a test example comes from is unknown. In this paper we extend UDA by proposing a new task called unsupervised domain expansion (UDE), which aims to adapt a deep model for the target domain with its unlabeled data, meanwhile maintaining the model's performance on the source domain. We propose Knowledge Distillation Domain Expansion (KDDE) as a general method for the UDE task. Its domain-adaptation module can be instantiated with any existing model. We develop a knowledge distillation based learning mechanism, enabling KDDE to optimize a single objective wherein the source and target domains are equally treated. Extensive experiments on two major benchmarks, i.e., Office-Home and DomainNet, show that KDDE compares favorably against four competitive baselines, i.e., DDC, DANN, DAAN, and CDAN, for both UDA and UDE tasks. Our study also reveals that the current UDA models improve their performance on the target domain at the cost of noticeable performance loss on the source domain.


title: A Survey on Natural Language Video Localization

abstract: Natural language video localization (NLVL), which aims to locate a target moment from a video that semantically corresponds to a text query, is a novel and challenging task. Toward this end, in this paper, we present a comprehensive survey of the NLVL algorithms, where we first propose the pipeline of NLVL, and then categorize them into supervised and weakly-supervised methods, following by the analysis of the strengths and weaknesses of each kind of methods. Subsequently, we present the dataset, evaluation protocols and the general performance analysis. Finally, the possible perspectives are obtained by summarizing the existing methods.


title: Multilingual and code-switching ASR challenges for low resource Indian languages

abstract: Recently, there is increasing interest in multilingual automatic speech recognition (ASR) where a speech recognition system caters to multiple low resource languages by taking advantage of low amounts of labeled corpora in multiple languages. With multilingualism becoming common in today's world, there has been increasing interest in code-switching ASR as well. In code-switching, multiple languages are freely interchanged within a single sentence or between sentences. The success of low-resource multilingual and code-switching ASR often depends on the variety of languages in terms of their acoustics, linguistic characteristics as well as the amount of data available and how these are carefully considered in building the ASR system. In this challenge, we would like to focus on building multilingual and code-switching ASR systems through two different subtasks related to a total of seven Indian languages, namely Hindi, Marathi, Odia, Tamil, Telugu, Gujarati and Bengali. For this purpose, we provide a total of ~600 hours of transcribed speech data, comprising train and test sets, in these languages including two code-switched language pairs, Hindi-English and Bengali-English. We also provide a baseline recipe for both the tasks with a WER of 30.73% and 32.45% on the test sets of multilingual and code-switching subtasks, respectively.


title: Too Expensive to Attack: A Joint Defense Framework to Mitigate Distributed Attacks for the Internet of Things Grid

abstract: The distributed denial of service (DDoS) attack is detrimental to businesses and individuals as we are heavily relying on the Internet. Due to remarkable profits, crackers favor DDoS as cybersecurity weapons in attacking servers, computers, IoT devices, and even the entire Internet. Many current detection and mitigation solutions concentrate on specific technologies in combating DDoS, whereas the attacking expense and the cross-defender collaboration have not drawn enough attention. Under this circumstance, we revisit the DDoS attack and defense in terms of attacking cost and populations of both parties, proposing a joint defense framework to incur higher attacking expense in a grid of Internet service providers (ISPs), businesses, individuals, and third-party organizations (IoT Grid). Meanwhile, the defender's cost does not grow much during combats. The skyrocket of attacking expense discourages profit-driven attackers from launching further attacks effectively. The quantitative evaluation and experimental assessment reinforce the effectiveness of our framework.


title: Optimizer Fusion: Efficient Training with Better Locality and Parallelism

abstract: Machine learning frameworks adopt iterative optimizers to train neural networks. Conventional eager execution separates the updating of trainable parameters from forward and backward computations. However, this approach introduces nontrivial training time overhead due to the lack of data locality and computation parallelism. In this work, we propose to fuse the optimizer with forward or backward computation to better leverage locality and parallelism during training. By reordering the forward computation, gradient calculation, and parameter updating, our proposed method improves the efficiency of iterative optimizers. Experimental results demonstrate that we can achieve an up to 20% training time reduction on various configurations. Since our methods do not alter the optimizer algorithm, they can be used as a general "plug-in" technique to the training process.