title: Cumulative geometric frustration in physical assemblies

abstract: Geometric frustration arises whenever the constituents of a physical assembly locally favor an arrangement that cannot be realized globally. Recently, such frustrated assemblies were shown to exhibit filamentation, size limitation, large morphological variations and other exotic response properties. While these unique characteristics can be shown to be a direct outcome of the geometric frustration, some geometrically frustrated systems do not exhibit any of the above phenomena. In this work we exploit the intrinsic approach to provide a framework for directly addressing the frustration in physical assemblies. The framework highlights the role of the compatibility conditions associated with the intrinsic fields describing the physical assembly. We show that the structure of the compatibility conditions determines the behavior of small assemblies, and in particular predicts their super-extensive energy growth exponent. We illustrate the use of this framework to several well known frustrated assemblies.


title: Population and Inequality Dynamics in Simple Economies

abstract: While the use of spatial agent-based and individual-based models has flourished across many scientific disciplines, the complexities these models generate are often difficult to manage and quantify. This research reduces population-driven, spatial modeling of individuals to the simplest configurations and parameters: an equal resource opportunity landscape with equally capable individuals; and asks the question, "Will valid complex population and inequality dynamics emerge from this simple economic model?" Two foraging economies are modeled: subsistence and surplus. The resulting, emergent population dynamics are characterized by their sensitivities to agent and landscape parameters. The various steady and oscillating regimes of single-species population dynamics are generated by appropriate selection of model growth parameters. These emergent dynamics are shown to be consistent with the equation-based, continuum modeling of single-species populations in biology and ecology. The intrinsic growth rates, carry capacities, and delay parameters of these models are implied for these simple economies. Aggregate measures of individual distributions are used to understand the sensitivities to model parameters. New local measures are defined to describe complex behaviors driven by spatial effects, especially extinctions. This simple economic model is shown to generate significantly complex population and inequality dynamics. Model parameters generating the intrinsic growth rate have strong effects on these dynamics, including large variations in inequality. Significant inequality effects are shown to be caused by birth costs above and beyond their contribution to the intrinsic growth rate. The highest levels of inequality are found during the initial non-equilibrium period and are driven by factors different than those driving steady state inequality.


title: Encrypted Internet traffic classification using a supervised Spiking Neural Network

abstract: Internet traffic recognition is an essential tool for access providers since recognizing traffic categories related to different data packets transmitted on a network help them define adapted priorities. That means, for instance, high priority requirements for an audio conference and low ones for a file transfer, to enhance user experience. As internet traffic becomes increasingly encrypted, the mainstream classic traffic recognition technique, payload inspection, is rendered ineffective. This paper uses machine learning techniques for encrypted traffic classification, looking only at packet size and time of arrival. Spiking neural networks (SNN), largely inspired by how biological neurons operate, were used for two reasons. Firstly, they are able to recognize time-related data packet features. Secondly, they can be implemented efficiently on neuromorphic hardware with a low energy footprint. Here we used a very simple feedforward SNN, with only one fully-connected hidden layer, and trained in a supervised manner using the newly introduced method known as Surrogate Gradient Learning. Surprisingly, such a simple SNN reached an accuracy of 95.9% on ISCX datasets, outperforming previous approaches. Besides better accuracy, there is also a very significant improvement on simplicity: input size, number of neurons, trainable parameters are all reduced by one to four orders of magnitude. Next, we analyzed the reasons for this good accuracy. It turns out that, beyond spatial (i.e. packet size) features, the SNN also exploits temporal ones, mostly the nearly synchronous (within a 200ms range) arrival times of packets with certain sizes. Taken together, these results show that SNNs are an excellent fit for encrypted internet traffic classification: they can be more accurate than conventional artificial neural networks (ANN), and they could be implemented efficiently on low power embedded systems.


title: Meta-Regularization by Enforcing Mutual-Exclusiveness

abstract: Meta-learning models have two objectives. First, they need to be able to make predictions over a range of task distributions while utilizing only a small amount of training data. Second, they also need to adapt to new novel unseen tasks at meta-test time again by using only a small amount of training data from that task. It is the second objective where meta-learning models fail for non-mutually exclusive tasks due to task overfitting. Given that guaranteeing mutually exclusive tasks is often difficult, there is a significant need for regularization methods that can help reduce the impact of task-memorization in meta-learning. For example, in the case of N-way, K-shot classification problems, tasks becomes non-mutually exclusive when the labels associated with each task is fixed. Under this design, the model will simply memorize the class labels of all the training tasks, and thus will fail to recognize a new task (class) at meta-test time. A direct observable consequence of this memorization is that the meta-learning model simply ignores the task-specific training data in favor of directly classifying based on the test-data input. In our work, we propose a regularization technique for meta-learning models that gives the model designer more control over the information flow during meta-training. Our method consists of a regularization function that is constructed by maximizing the distance between task-summary statistics, in the case of black-box models and task specific network parameters in the case of optimization based models during meta-training. Our proposed regularization function shows an accuracy boost of $\sim$ $36\%$ on the Omniglot dataset for 5-way, 1-shot classification using black-box method and for 20-way, 1-shot classification problem using optimization-based method.


title: Anomalous dimensions at large charge in d=4 O(N) theory

abstract: Recently it was shown that the scaling dimension of the operator $\phi^n$ in $\lambda(\phi^*\phi)^2$ theory may be computed semi-classically at the Wilson-Fisher fixed point in $d=4-\epsilon$, for generic values of $\lambda n$ and this was verified to two loop order in perturbation theory at leading and sub-leading $n$. In subsequent work, this result was generalised to operators of fixed charge $Q$ in $O(N)$ theory and verified up to three loops in perturbation theory at leading and sub-leading order. Here we extend this verification to four loops in $O(N)$ theory, once again at leading and sub-leading order. We also investigate the strong-coupling regime.


title: A Survey of Novel Cache Hierarchy Designs for High Workloads

abstract: Traditional on-die, three-level cache hierarchy design is very commonly used but is also prone to latency, especially at the Level 2 (L2) cache. We discuss three distinct ways of improving this design in order to have better performance. Performance is especially important for systems with high workloads. The first method proposes to eliminate L2 altogether while proposing a new prefetching technique, the second method suggests increasing the size of L2, while the last method advocates the implementation of optical caches. After carefully contemplating the results in performance gains and the advantages and disadvantages of each method, we found the last method to be the best of the three.


title: PSR J1810+1744: Companion Darkening and a Precise High Neutron Star Mass

abstract: Keck-telescope spectrophotometry of the companion of PSR J1810+1744 shows a flat, but asymmetric light-curve maximum and a deep, narrow minimum. The maximum indicates strong gravity darkening near the L_1 point, along with a heated pole and surface winds. The minimum indicates a low underlying temperature and substantial limb darkening. The gravity darkening is a consequence of extreme pulsar heating and the near-filling of the Roche lobe. Light-curve modeling gives a binary inclination i=65.7+/-0.4deg. With the Keck-measured radial-velocity amplitude K_c=462.3+/-2.2km/s, this gives an accurate neutron star mass M_NS=2.13+/-0.04M_o, with important implications for the dense-matter equation of state. A classic direct-heating model, ignoring the L_1 gravitational darkening, would predict an unphysical M_NS>3M_o. A few other ``spider" pulsar binaries have similar large heating and fill factor; thus, they should be checked for such effects.


title: A novel reconstruction technique for two-dimensional Bragg scatter imaging

abstract: Here we introduce a new reconstruction technique for two-dimensional Bragg Scattering Tomography (BST), based on the Radon transform models of [arXiv preprint, arXiv:2004.10961 (2020)]. Our method uses a combination of ideas from multibang control and microlocal analysis to construct an objective function which can regularize the BST artifacts; specifically the boundary artifacts due to sharp cutoff in sinogram space (as observed in [arXiv preprint, arXiv:2007.00208 (2020)]), and artifacts arising from approximations made in constructing the model used for inversion. We then test our algorithm in a variety of Monte Carlo (MC) simulated examples of practical interest in airport baggage screening and threat detection. The data used in our studies is generated with a novel Monte-Carlo code presented here. The model, which is available from the authors upon request, captures both the Bragg scatter effects described by BST as well as beam attenuation and Compton scatter.


title: Beyond Expertise and Roles: A Framework to Characterize the Stakeholders of Interpretable Machine Learning and their Needs

abstract: To ensure accountability and mitigate harm, it is critical that diverse stakeholders can interrogate black-box automated systems and find information that is understandable, relevant, and useful to them. In this paper, we eschew prior expertise- and role-based categorizations of interpretability stakeholders in favor of a more granular framework that decouples stakeholders' knowledge from their interpretability needs. We characterize stakeholders by their formal, instrumental, and personal knowledge and how it manifests in the contexts of machine learning, the data domain, and the general milieu. We additionally distill a hierarchical typology of stakeholder needs that distinguishes higher-level domain goals from lower-level interpretability tasks. In assessing the descriptive, evaluative, and generative powers of our framework, we find our more nuanced treatment of stakeholders reveals gaps and opportunities in the interpretability literature, adds precision to the design and comparison of user studies, and facilitates a more reflexive approach to conducting this research.


title: Improving Few-Shot Learning with Auxiliary Self-Supervised Pretext Tasks

abstract: Recent work on few-shot learning \cite{tian2020rethinking} showed that quality of learned representations plays an important role in few-shot classification performance. On the other hand, the goal of self-supervised learning is to recover useful semantic information of the data without the use of class labels. In this work, we exploit the complementarity of both paradigms via a multi-task framework where we leverage recent self-supervised methods as auxiliary tasks. We found that combining multiple tasks is often beneficial, and that solving them simultaneously can be done efficiently. Our results suggest that self-supervised auxiliary tasks are effective data-dependent regularizers for representation learning. Our code is available at: \url{https://github.com/nathanielsimard/improving-fs-ssl}.


title: Uniform Sobolev estimates in $\mathbb{R}^{n}$ involving singular potentials

abstract: We generalize the Stein-Tomas [17] $L^2$-restricition theorem and the uniform Sobolev estimates of Kenig, Ruiz and the second author [11] by allowing critically singular potential. We also obtain Strichartz estimates for Schr\"odinger and wave operators with such potentials. Due to the fact that there may be nontrivial eigenfunctions we are required to make certain spectral assumptions, such as assuming that the solutions only involve sufficiently large frequencies.


title: New constructions of nef classes on self-products of curves

abstract: We study the nef cone of self-products of a curve. When the curve is very general of genus $g>2$, we construct a nontrivial class of self-intersection 0 on the boundary of the nef cone. Up to symmetry, this is the only known nontrivial boundary example that exists for all $g > 2$. When the curve is general, we identify nef classes that improve on known examples for arbitrary curves. We also consider self-products of more than two copies of the curve.


title: Displacement-pseudostress formulation for the linear elasticity spectral problem

abstract: In this paper we analyze a mixed displacement-pseudostress formulation for the elasticity eigenvalue problem. We propose a finite element method to approximate the pseudostress tensor with Raviart-Thomas elements and the displacement with piecewise polynomials. With the aid of the classic theory for compact operators, we prove that our method is convergent and does not introduce spurious modes. Also, we obtain error estimates for the proposed method. Finally, we report some numerical tests supporting the theoretical results.


title: Large Gap Quantum Anomalous Hall Effect in a Type-I Heterostructure Between a Magnetically Doped Topological Insulator and Antiferromagnetic Insulator

abstract: Heterostructures between topological insulators (TI) and magnetic insulators represent a pathway to realize the quantum anomalous Hall effect (QAHE). Using density functional theory based systematic screening and investigation of thermodynamic, magnetic and topological properties of heterostructures, we demonstrate that forming a type-I heterostructure between a wide gap antiferromagnetic insulator Cr$_2$O$_3$ and a TI-film, such as Sb$_2$Te$_3$, can lead to pinning of the Fermi-level at the center of the gap, even when magnetically doped. Cr-doping in the heterostructure increases the gap to $\sim$ 64.5 meV, with a large Zeeman energy from the interfacial Cr dopants, thus overcoming potential metallicity due to band bending effects. By fitting the band-structure around the Fermi-level to a 4-band k.p model Hamiltonian, we show that Cr doped Sb$_2$Te$_3$/Cr$_2$O$_3$ is a Chern insulator with a Chern number C = -1. Transport calculations further show chiral edge-modes localized at the top/bottom of the TI-film to be the dominant current carriers in the material. Our predictions of a large interfacial magnetism due to Cr-dopants, that coupled antiferromagnetically to the AFM substrate is confirmed by our polarised neutron reflectometry measurements on MBE grown Cr doped Sb$_2$Te$_3$/Cr$_2$O$_3$ heterostructures, and is consistent with a positive exchange bias measured in such systems recently. Consequently, Cr doped Sb$_2$Te$_3$/Cr$_2$O$_3$ heterostructure represents a promising platform for the development of functional topological magnetic devices, with high tunability.


title: A Generalization of QR Factorization To Non-Euclidean Norms

abstract: I propose a way to use non-Euclidean norms to formulate a QR-like factorization which can unlock interesting and potentially useful properties of non-Euclidean norms - for example the ability of $l^1$ norm to suppresss outliers or promote sparsity. A classic QR factorization of a matrix $\mathbf{A}$ computes an upper triangular matrix $\mathbf{R}$ and orthogonal matrix $\mathbf{Q}$ such that $\mathbf{A} = \mathbf{QR}$. To generalize this factorization to a non-Euclidean norm $\| \cdot \|$ I relax the orthogonality requirement for $\mathbf{Q}$ and instead require it have condition number $\kappa \left ( \mathbf{Q} \right ) = \| \mathbf{Q} ^{-1} \| \| \mathbf{Q} \|$ that is bounded independently of $\mathbf{A}$. I present the algorithm for computing $\mathbf{Q}$ and $\mathbf{R}$ and prove that this algorithm results in $\mathbf{Q}$ with the desired properties. I also prove that this algorithm generalizes classic QR factorization in the sense that when the norm is chosen to be Euclidean: $\| \cdot \|=\| \cdot \|_2$ then $\mathbf{Q}$ is orthogonal. Finally I present numerical results confirming mathematical results with $l^1$ and $l^{\infty}$ norms. I supply Python code for experimentation.


title: Complications in the ALMA Detection of Phosphine at Venus

abstract: Recently published ALMA observations suggest the presence of 20 ppb PH$_3$ in the upper clouds of Venus. This is an unexpected result, as PH$_3$ does not have a readily apparent source and should be rapidly photochemically destroyed according to our current understanding of Venus atmospheric chemistry. While the reported PH$_3$ spectral line at 266.94 GHz is nearly co-located with an SO$_2$ spectral line, the non-detection of stronger SO$_2$ lines in the wideband ALMA data is used to rule out SO$_2$ as the origin of the feature. We present a reassessment of wideband and narrowband datasets derived from these ALMA observations. The ALMA observations are re-reduced following both the initial and revised calibration procedures discussed by the authors of the original study. We also investigate the phenomenon of apparent spectral line dilution over varying spatial scales resulting from the ALMA antenna configuration. A 266.94 GHz spectral feature is apparent in the narrowband data using the initial calibration procedures, but this same feature can not be identified following calibration revisions. The feature is also not reproduced in the wideband data. While the SO$_2$ spectral line is not observed at 257.54 GHz in the ALMA wideband data, our dilution simulations suggest that SO$_2$ abundances greater than the previously suggested 10 ppb limit would also not be detected by ALMA. Additional millimeter, sub-millimeter, and infrared observations of Venus should be undertaken to further investigate the possibility of PH$_3$ in the Venus atmosphere.


title: Determination of angular distributions from the high efficiency solenoidal separator SOLITAIRE

abstract: A novel fusion product separator, based on a gas-filled 8 T superconducting solenoid has been developed at the Australian National University. Though the transmission efficiency of the solenoid is very high, precision cross section measurements require knowledge of the angular distribution of the evaporation residues. A method has been developed to deduce the angular distribution of the evaporation residues from the laboratory-frame velocity distribution of the evaporation residues measured at the exit of the separator. The features of this method are presented, focusing on the example of $^{34}$S+$^{89}$Y which is compared to an independent measurement of the angular distribution. The establishment of this method now allows the novel solenoidal separator to be used to obtain reliable, precision fusion cross-sections.


title: Inferring incompressible two-phase flow fields from the interface motion using physics-informed neural networks

abstract: In this work, physics-informed neural networks are applied to incompressible two-phase flow problems. We investigate the forward problem, where the governing equations are solved from initial and boundary conditions, as well as the inverse problem, where continuous velocity and pressure fields are inferred from scattered-time data on the interface position. We employ a volume of fluid approach, i.e. the auxiliary variable here is the volume fraction of the fluids within each phase. For the forward problem, we solve the two-phase Couette and Poiseuille flow. For the inverse problem, three classical test cases for two-phase modeling are investigated: (i) drop in a shear flow, (ii) oscillating drop and (iii) rising bubble. Data of the interface position over time is generated by numerical simulation. An effective way to distribute spatial training points to fit the interface, i.e. the volume fraction field, and the residual points is proposed. Furthermore, we show that appropriate weighting of losses associated with the residual of the partial differential equations is crucial for successful training. The benefit of using adaptive activation functions is evaluated for both the forward and inverse problem.


title: Privacy Preserving Techniques Applied to CPNI Data: Analysis and Recommendations

abstract: With mobile phone penetration rates reaching 90%, Consumer Proprietary Network Information (CPNI) can offer extremely valuable information to different sectors, including policymakers. Indeed, as part of CPNI, Call Detail Records have been successfully used to provide real-time traffic information, to improve our understanding of the dynamics of people's mobility and so to allow prevention and measures in fighting infectious diseases, and to offer population statistics. While there is no doubt of the usefulness of CPNI data, privacy concerns regarding sharing individuals' data have prevented it from being used to its full potential. Traditional de-anonymization measures, such as pseudonymization and standard de-identification, have been shown to be insufficient to protect privacy. This has been specifically shown on mobile phone datasets. As an example, researchers have shown that with only four data points of approximate place and time information of a user, 95% of users could be re-identified in a dataset of 1.5 million mobile phone users. In this landscape paper, we will discuss the state-of-the-art anonymization techniques and their shortcomings.


title: Particle Swarm Optimization: Development of a General-Purpose Optimizer

abstract: Traditional methods present a very restrictive range of applications, mainly limited by the features of the function to be optimized and of the constraint functions. In contrast, evolutionary algorithms present almost no restriction to the features of these functions, although the most appropriate constraint-handling technique is still an open question. The particle swarm optimization (PSO) method is sometimes viewed as another evolutionary algorithm because of their many similarities, despite not being inspired by the same metaphor. Namely, they evolve a population of individuals taking into consideration previous experiences and using stochastic operators to introduce new responses. The advantages of evolutionary algorithms with respect to traditional methods have been greatly discussed in the literature for decades. While all such advantages are valid when comparing the PSO paradigm to traditional methods, its main advantages with respect to evolutionary algorithms consist of its noticeably lower computational cost and easier implementation. In fact, the plain version can be programmed in a few lines of code, involving no operator design and few parameters to be tuned. This paper deals with three important aspects of the method: the influence of the parameters' tuning on the behaviour of the system; the design of stopping criteria so that the reliability of the solution found can be somehow estimated and computational cost can be saved; and the development of appropriate techniques to handle constraints, given that the original method is designed for unconstrained optimization problems.


title: IceCube Data for Neutrino Point-Source Searches Years 2008-2018

abstract: IceCube has performed several all-sky searches for point-like neutrino sources using track-like events, including a recent time-integrated analysis using 10 years of IceCube data. This paper accompanies the public data release of these neutrino candidates detected by IceCube between April 6, 2008 and July 8, 2018. The selection includes through-going tracks, primarily due to muon neutrino candidates, that reach the detector from all directions, as well as neutrino track events that start within the instrumented volume. An updated selection and reconstruction for data taken after April 2012 slightly improves the sensitivity of the sample. While more than 80% of the sample overlaps between the old and new versions, differing events can lead to changes relative to the previous 7 year event selection. An a posteriori estimate of the significance of the 2014-2015 TXS flare is reported with an explanation of observed discrepancies with previous results. This public data release, which includes 10 years of data and binned detector response functions for muon neutrino signal events, shows improved sensitivity in generic time-integrated point source analyses and should be preferred over previous releases.


title: Claimed detection of PH$_3$ in the clouds of Venus is consistent with mesospheric SO$_2$

abstract: The observation of a 266.94 GHz feature in the Venus spectrum has been attributed to PH$_3$ in the Venus clouds, suggesting unexpected geological, chemical or even biological processes. Since both PH$_3$ and SO$_2$ are spectrally active near 266.94 GHz, the contribution to this line from SO$_2$ must be determined before it can be attributed, in whole or part, to PH$_3$. An undetected SO$_2$ reference line, interpreted as an unexpectedly low SO$_2$ abundance, suggested that the 266.94 GHz feature could be attributed primarily to PH$_3$. However, the low SO$_2$ and the inference that PH$_3$ was in the cloud deck posed an apparent contradiction. Here we use a radiative transfer model to analyze the PH$_3$ discovery, and explore the detectability of different vertical distributions of PH$_3$ and SO$_2$. We find that the 266.94 GHz line does not originate in the clouds, but above 80 km in the Venus mesosphere. This level of line formation is inconsistent with chemical modeling that assumes generation of PH$_3$ in the Venus clouds. Given the extremely short chemical lifetime of PH$_3$ in the Venus mesosphere, an implausibly high source flux would be needed to maintain the observed value of 20$\pm$10 ppb. We find that typical Venus SO$_2$ vertical distributions and abundances fit the JCMT 266.94 GHz feature, and the resulting SO$_2$ reference line at 267.54 GHz would have remained undetectable in the ALMA data due to line dilution. We conclude that nominal mesospheric SO$_2$ is a more plausible explanation for the JCMT and ALMA data than PH$_3$.


title: A two species micro-macro model of wormlike micellar solutions and its maximum entropy closure approximations: An energetic variational approach

abstract: Wormlike micelles are self-assemblies of polymer chains that can break and recombine reversibly. In this paper, we derive a thermodynamically consistent two species micro-macro model of wormlike micellar solutions by employing an energetic variational approach. The model incorporates a breakage and combination process of polymer chains into the classical micro-macro dumbbell model for polymeric fluids in a unified variational framework. We also study different maximum entropy closure approximations to the new model by "variation-then-closure" and "closure-then-variation" approaches. By imposing proper dissipation in the coarse-grained level, the closure model, obtained by "closure-then-approximation", preserves the thermodynamical structure of both mechanical and chemical parts of the original system. Several numerical examples show that the closure model can capture the key rheological features of wormlike micellar solutions in shear flows.

categories: physics.flu-dyn cond-mat.soft cs.NA math.NA


title: Variational Multi-scale Super-resolution : A data-driven approach for reconstruction and predictive modeling of unresolved physics

abstract: The variational multiscale (VMS) formulation formally segregates the evolution of the coarse-scales from the fine-scales. VMS modeling requires the approximation of the impact of the fine scales in terms of the coarse scales. In linear problems, our formulation reduces the problem of learning the sub-scales to learning the projected element Green's function basis coefficients. For the purpose of this approximation, a special neural-network structure - the variational super-resolution N-N (VSRNN) - is proposed. The VSRNN constructs a super-resolved model of the unresolved scales as a sum of the products of individual functions of coarse scales and physics-informed parameters. Combined with a set of locally non-dimensional features obtained by normalizing the input coarse-scale and output sub-scale basis coefficients, the VSRNN provides a general framework for the discovery of closures for both the continuous and the discontinuous Galerkin discretizations. By training this model on a sequence of $L_2-$projected data and using the subscale to compute the continuous Galerkin subgrid terms, and the super-resolved state to compute the discontinuous Galerkin fluxes, we improve the optimality and the accuracy of these methods for the convection-diffusion problem, linear advection and turbulent channel flow. Finally, we demonstrate that - in the investigated examples - the present model allows generalization to out-of-sample initial conditions and Reynolds numbers. Perspectives are provided on data-driven closure modeling, limitations of the present approach, and opportunities for improvement.


title: TLRM: Task-level Relation Module for GNN-based Few-Shot Learning

abstract: Recently, graph neural networks (GNNs) have shown powerful ability to handle few-shot classification problem, which aims at classifying unseen samples when trained with limited labeled samples per class. GNN-based few-shot learning architectures mostly replace traditional metric with a learnable GNN. In the GNN, the nodes are set as the samples embedding, and the relationship between two connected nodes can be obtained by a network, the input of which is the difference of their embedding features. We consider this method of measuring relation of samples only models the sample-to-sample relation, while neglects the specificity of different tasks. That is, this method of measuring relation does not take the task-level information into account. To this end, we propose a new relation measure method, namely the task-level relation module (TLRM), to explicitly model the task-level relation of one sample to all the others. The proposed module captures the relation representations between nodes by considering the sample-to-task instead of sample-to-sample embedding features. We conducted extensive experiments on four benchmark datasets: mini-ImageNet, tiered-ImageNet, CUB-$200$-$2011$, and CIFAR-FS. Experimental results demonstrate that the proposed module is effective for GNN-based few-shot learning.


title: E-cheating Prevention Measures: Detection of Cheating at Online Examinations Using Deep Learning Approach -- A Case Study

abstract: This study addresses the current issues in online assessments, which are particularly relevant during the Covid-19 pandemic. Our focus is on academic dishonesty associated with online assessments. We investigated the prevalence of potential e-cheating using a case study and propose preventive measures that could be implemented. We have utilised an e-cheating intelligence agent as a mechanism for detecting the practices of online cheating, which is composed of two major modules: the internet protocol (IP) detector and the behaviour detector. The intelligence agent monitors the behaviour of the students and has the ability to prevent and detect any malicious practices. It can be used to assign randomised multiple-choice questions in a course examination and be integrated with online learning programs to monitor the behaviour of the students. The proposed method was tested on various data sets confirming its effectiveness. The results revealed accuracies of 68% for the deep neural network (DNN); 92% for the long-short term memory (LSTM); 95% for the DenseLSTM; and, 86% for the recurrent neural network (RNN).


title: Approximate Integrals Over Bounded Volumes with Smooth Boundaries

abstract: A Radial Basis Function Generated Finite-Differences (RBF-FD) inspired technique for evaluating definite integrals over bounded volumes that have smooth boundaries in three dimensions is described. A key aspect of this approach is that it allows the user to approximate the value of the integral without explicit knowledge of an expression for the boundary surface. Instead, a tesselation of the node set is utilized to inform the algorithm of the domain geometry. Further, the method applies to node sets featuring spatially varying density, facilitating its use in Applied Mathematics, Mathematical Physics and myriad other application areas, where the locations of the nodes might be fixed by experiment or previous simulation. By using the RBF-FD-like approach, the proposed algorithm computes quadrature weights for $N$ arbitrarily scattered nodes in only $O(N\mbox{ log}N)$ operations with tunable orders of accuracy.


title: Multiple stellar populations in Asymptotic Giant Branch stars of Galactic Globular Clusters

abstract: Multiple stellar populations (MPs) are a distinct characteristic of Globular Clusters (GCs). Their general properties have been widely studied among main sequence, red giant branch (RGB) and horizontal branch (HB) stars, but a common framework is still missing at later evolutionary stages. We studied the MP phenomenon along the AGB sequences in 58 GCs, observed with the Hubble Space Telescope in ultraviolet (UV) and optical filters. By using UV-optical color-magnitude diagrams, we selected the AGB members of each cluster and identified the AGB candidates of the metal-enhanced population in type II GCs. We studied the photometric properties of AGB stars and compared them to theoretical models derived from synthetic spectra analysis. We observe the following features: i) the spread of AGB stars in photometric indices sensitive to variations of light-elements and helium is typically larger than that expected from photometric errors; ii) the fraction of metal-enhanced stars in the AGB is lower than in the RGB in most of the type II GCs; iii) the fraction of 1G stars derived from the chromosome map of AGB stars in 15 GCs is larger than that of RGB stars; v) the AGB/HB frequency correlates with the average mass of the most helium-enriched population. These findings represent a clear evidence of the presence of MPs along the AGB of Galactic GCs and indicate that a significant fraction of helium-enriched stars, which have lower mass in the HB, does not evolve to the AGB phase, leaving the HB sequence towards higher effective temperatures, as predicted by the AGB-manqu\'e scenario.


title: Pattern Ensembling for Spatial Trajectory Reconstruction

abstract: Digital sensing provides an unprecedented opportunity to assess and understand mobility. However, incompleteness, missing information, possible inaccuracies, and temporal heterogeneity in the geolocation data can undermine its applicability. As mobility patterns are often repeated, we propose a method to use similar trajectory patterns from the local vicinity and probabilistically ensemble them to robustly reconstruct missing or unreliable observations. We evaluate the proposed approach in comparison with traditional functional trajectory interpolation using a case of sea vessel trajectory data provided by The Automatic Identification System (AIS). By effectively leveraging the similarities in real-world trajectories, our pattern ensembling method helps to reconstruct missing trajectory segments of extended length and complex geometry. It can be used for locating mobile objects when temporary unobserved as well as for creating an evenly sampled trajectory interpolation useful for further trajectory mining.


title: Electromagnetic fields from the extended Kharzeev-McLerran-Warringa model in relativistic heavy-ion collisions

abstract: Based on the Kharzeev-McLerran-Warringa (KMW) model that estimates strong electromagnetic (EM) fields generated in relativistic heavy-ion collisions, we generalize the formulas of EM fields in the vacuum by incorporating the longitudinal position dependence, the generalized charge distributions and retardation correction. We further generalize the formulas of EM fields in the pure quark-gluon plasma (QGP) medium by incorporating a constant Ohm electric conductivity and also during the realistic early-time stages QGP evolution by using a time-dependent electric conductivity. Using the extended KMW model, we observe a slower time evolution and a more reasonable impact parameter $b$ dependence of the magnetic field strength than those from the original KMW model in the vacuum. The inclusion of medium effects by using the lattice data helps to further prolong the time evolution of magnetic field, such that the magnetic field strength during the realistic QGP evolution at thermal freeze-out time can meet the $1\sigma$ bound constrained from experimentally measured difference in global polarizations of $\Lambda$ and $\bar{\Lambda}$ hyperons in Au+Au collisions at top RHIC energy. These generalized formulations in the extended KMW model will be potentially useful for many EM fields relevant studies in heavy-ion collisions, especially at lower colliding energies and for various species of colliding nuclei.


title: Proof of the Ballantine-Merca Conjecture and theta function identities modulo 2

abstract: For positive integers $m$ we consider the theta functions $f_m(z):=\sum_{mk+1\text{ square }}q^k$. Due to classical identities of Jacobi, it is known that $$f_4\equiv f_6f_{12}\pmod 2.$$ Here we prove that the only triples $(a,b,c)$ for which $f_a\equiv f_bf_c\pmod 2$ are of the form $(2q,4q,4q)$ or $(4q,4q,8q)$, where $q$ is any positive odd number, or belong to the following finite list $$\{(4,6,12),(6,8,24),(8,12,24),(10,12,60),(15,24,40),(16,24,48),(20,24,120),(21,24,168)\}.$$ The result is inspired by the Ballantine-Merca Conjecture on recurrence relations for the parity of the partition function $p(n)$, which we also prove here.


title: High-Confidence Off-Policy (or Counterfactual) Variance Estimation

abstract: Many sequential decision-making systems leverage data collected using prior policies to propose a new policy. For critical applications, it is important that high-confidence guarantees on the new policy's behavior are provided before deployment, to ensure that the policy will behave as desired. Prior works have studied high-confidence off-policy estimation of the expected return, however, high-confidence off-policy estimation of the variance of returns can be equally critical for high-risk applications. In this paper, we tackle the previously open problem of estimating and bounding, with high confidence, the variance of returns from off-policy data


title: A new approach to extracting coronary arteries and detecting stenosis in invasive coronary angiograms

abstract: In stable coronary artery disease (CAD), reduction in mortality and/or myocardial infarction with revascularization over medical therapy has not been reliably achieved. Coronary arteries are usually extracted to perform stenosis detection. We aim to develop an automatic algorithm by deep learning to extract coronary arteries from ICAs.In this study, a multi-input and multi-scale (MIMS) U-Net with a two-stage recurrent training strategy was proposed for the automatic vessel segmentation. Incorporating features such as the Inception residual module with depth-wise separable convolutional layers, the proposed model generated a refined prediction map with the following two training stages: (i) Stage I coarsely segmented the major coronary arteries from pre-processed single-channel ICAs and generated the probability map of vessels; (ii) during the Stage II, a three-channel image consisting of the original preprocessed image, a generated probability map, and an edge-enhanced image generated from the preprocessed image was fed to the proposed MIMS U-Net to produce the final segmentation probability map. During the training stage, the probability maps were iteratively and recurrently updated by feeding into the neural network. After segmentation, an arterial stenosis detection algorithm was developed to extract vascular centerlines and calculate arterial diameters to evaluate stenotic level. Experimental results demonstrated that the proposed method achieved an average Dice score of 0.8329, an average sensitivity of 0.8281, and an average specificity of 0.9979 in our dataset with 294 ICAs obtained from 73 patient. Moreover, our stenosis detection algorithm achieved a true positive rate of 0.6668 and a positive predictive value of 0.7043.


title: Deep Learning Generalization and the Convex Hull of Training Sets

abstract: We study the generalization of deep learning models in relation to the convex hull of their training sets. A trained image classifier basically partitions its domain via decision boundaries and assigns a class to each of those partitions. The location of decision boundaries inside the convex hull of training set can be investigated in relation to the training samples. However, our analysis shows that in standard image classification datasets, all testing images are considerably outside that convex hull, in the pixel space, in the wavelet space, and in the internal representations learned by deep networks. Therefore, the performance of a trained model partially depends on how its decision boundaries are extended outside the convex hull of its training data. From this perspective which is not studied before, over-parameterization of deep learning models may be considered a necessity for shaping the extension of decision boundaries. At the same time, over-parameterization should be accompanied by a specific training regime, in order to yield a model that not only fits the training set, but also its decision boundaries extend desirably outside the convex hull. To illustrate this, we investigate the decision boundaries of a neural network, with various degrees of parameters, inside and outside the convex hull of its training set. Moreover, we use a polynomial decision boundary to study the necessity of over-parameterization and the influence of training regime in shaping its extensions outside the convex hull of training set.


title: On the progenitors of AM CVn stars as LISA sources: the evolved donor star channel

abstract: The space gravitational wave (GW) detector Laser Interferometer Space Antenna (LISA) that was planed to launch in the early 2030s is to detect the low-frequency GW signals in the Galaxy. AM CVn stars were generally thought to be important low-frequency GW sources. Employing the MESA code, in this work we calculate the evolution of a great number of binary systems consisting of a white dwarf (WD) and a main sequence (MS) star, and diagnose whether their descendants-AM CVn stars can be visible by the LISA. The simulated results show that the progenitors of these LISA sources within a distance of 1 kpc are WD-MS binaries with a donor star of $1.0-1.4~M_\odot$ (for initial WD mass of $0.5~M_\odot$) or $1.0-2.0~M_\odot$ (for initial WD mass of $0.7~M_\odot$), and an initial orbital period slightly smaller than the bifurcation period. Our simulations also indicate ten verification AM CVn sources can be reproduced by the standard magnetic braking model, and are potential LISA sources. Based on the birthrate of AM CVns simulated by the population synthesis, the birthrate of AM CVn-LISA sources evolving from the evolved donor star channel within a distance of 1 kpc can be estimated to be $(0.6-1.4)\times10^{-6}~\rm yr^{-1}$, and the predicted number of AM CVn-LISA sources is about $340-810$. Therefore, the evolved donor star channel play an important role in forming AM CVn-LISA sources in the Galaxy.


title: The Ion Transition Range of Solar Wind Turbulence in the Inner Heliosphere: Parker Solar Probe Observations

abstract: The scaling of the turbulent spectra provides a key measurement that allows to discriminate between different theoretical predictions of turbulence. In the solar wind, this has driven a large number of studies dedicated to this issue using in-situ data from various orbiting spacecraft. While a semblance of consensus exists regarding the scaling in the MHD and dispersive ranges, the precise scaling in the transition range and the actual physical mechanisms that control it remain open questions. Using the high-resolution data in the inner heliosphere from Parker Solar Probe (PSP) mission, we find that the sub-ion scales (i.e., at the frequency f ~ [2, 9] Hz) follow a power-law spectrum f^a with a spectral index a varying between -3 and -5.7. Our results also show that there is a trend toward and anti-correlation between the spectral slopes and the power amplitudes at the MHD scales, in agreement with previous studies: the higher the power amplitude the steeper the spectrum at sub-ion scales. A similar trend toward an anti-correlation between steep spectra and increasing normalized cross helicity is found, in agreement with previous theoretical predictions about the imbalanced solar wind. We discuss the ubiquitous nature of the ion transition range in solar wind turbulence in the inner heliosphere.


title: Linking the Dynamics of User Stance to the Structure of Online Discussions

abstract: This paper studies the dynamics of opinion formation and polarization in social media. We investigate whether users' stance concerning contentious subjects is influenced by the online discussions they are exposed to and interactions with users supporting different stances. We set up a series of predictive exercises based on machine learning models. Users are described using several posting activities features capturing their overall activity levels, posting success, the reactions their posts attract from users of different stances, and the types of discussions in which they engage. Given the user description at present, the purpose is to predict their stance in the future. Using a dataset of Brexit discussions on the Reddit platform, we show that the activity features regularly outperform the textual baseline, confirming the link between exposure to discussion and opinion. We find that the most informative features relate to the stance composition of the discussion in which users prefer to engage.


title: Cartesian exponentiation and monadicity

abstract: An important result in quasi-category theory due to Lurie is the that cocartesian fibrations are exponentiable, in the sense that pullback along a cocartesian fibration admits a right Quillen right adjoint that moreover preserves cartesian fibrations; the same is true with the cartesian and cocartesian fibrations interchanged. To explicate this classical result, we prove that the pullback along a cocartesian fibration between quasi-categories forms the oplax colimit of its "straightening," a homotopy coherent diagram valued in quasi-categories, recovering a result first observed by Gepner, Haugseng, and Nikolaus. As an application of the exponentiation operation of a cartesian fibration by a cocartesian one, we use the Yoneda lemma to construct left and right adjoints to the forgetful functor that carries a cartesian fibration over B to its obB-indexed family of fibers, and prove that this forgetful functor is monadic and comonadic. This monadicity is then applied to construct the reflection of a cartesian fibration into a groupoidal cartesian fibration, whose fibers are Kan complexes rather than quasi-categories.


title: Redshift-space distortions with split densities

abstract: Accurate modelling of redshift-space distortions (RSD) is challenging in the non-linear regime for two-point statistics e.g. the two-point correlation function (2PCF). We take a different perspective to split the galaxy density field according to the local density, and cross-correlate those densities with the entire galaxy field. Using mock galaxies, we demonstrate that combining a series of cross-correlation functions (CCFs) offers improvements over the 2PCF as follows: 1. The distribution of peculiar velocities in each split density is nearly Gaussian. This allows the Gaussian streaming model for RSD to perform accurately within the statistical errors of a ($1.5\,h^{-1}$Gpc)$^3$ volume for almost all scales and all split densities. 2. The PDF of the density field at small scales is non-Gaussian, but the CCFs of split densities capture the non-Gaussianity, leading to improved cosmological constraints over the 2PCF. We can obtain unbiased constraints on the growth parameter $f\sigma_{12}$ at the per-cent level, and Alcock-Paczynski (AP) parameters at the sub-per-cent level with the minimal scale of $15\,h^{-1}{\rm Mpc}$. This is a $\sim$30 per cent and $\sim$6 times improvement over the 2PCF, respectively. The diverse and steep slopes of the CCFs at small scales are likely to be responsible for the improved constraints of AP parameters. 3. Baryon acoustic oscillations (BAO) are contained in all CCFs of split densities. Including BAO scales helps to break the degeneracy between the line-of-sight and transverse AP parameters, allowing independent constraints on them. We discuss and compare models for RSD around spherical densities.


title: Weak Signal Asymptotics for Sequentially Randomized Experiments

abstract: We use the lens of weak signal asymptotics to study a class of sequentially randomized experiments, including those that arise in solving multi-armed bandit problems. In an experiment with $n$ time steps, we let the mean reward gaps between actions scale to the order $1/\sqrt{n}$ so as to preserve the difficulty of the learning task as $n$ grows. In this regime, we show that the sample paths of a class of sequentially randomized experiments -- adapted to this scaling regime and with arm selection probabilities that vary continuously with state -- converge weakly to a diffusion limit, given as the solution to a stochastic differential equation. The diffusion limit enables us to derive refined, instance-specific characterization of stochastic dynamics, and to obtain several insights on the regret and belief evolution of a number of sequential experiments including Thompson sampling (but not UCB, which does not satisfy our continuity assumption). We show that all sequential experiments whose randomization probabilities have a Lipschitz-continuous dependence on the observed data suffer from sub-optimal regret performance when the reward gaps are relatively large. Conversely, we find that a version of Thompson sampling with an asymptotically uninformative prior variance achieves near-optimal instance-specific regret scaling, including with large reward gaps, but these good regret properties come at the cost of highly unstable posterior beliefs.


title: UAV-Assisted Over-the-Air Computation

abstract: Over-the-air computation (AirComp) provides a promising way to support ultrafast aggregation of distributed data. However, its performance cannot be guaranteed in long-distance transmission due to the distortion induced by the channel fading and noise. To unleash the full potential of AirComp, this paper proposes to use a low-cost unmanned aerial vehicle (UAV) acting as a mobile base station to assist AirComp systems. Specifically, due to its controllable high-mobility and high-altitude, the UAV can move sufficiently close to the sensors to enable line-of-sight transmission and adaptively adjust all the links' distances, thereby enhancing the signal magnitude alignment and noise suppression. Our goal is to minimize the time-averaging mean-square error for AirComp by jointly optimizing the UAV trajectory, the scaling factor at the UAV, and the transmit power at the sensors, under constraints on the UAV's predetermined locations and flying speed, sensors' average and peak power limits. However, due to the highly coupled optimization variables and time-dependent constraints, the resulting problem is non-convex and challenging. We thus propose an efficient iterative algorithm by applying the block coordinate descent and successive convex optimization techniques. Simulation results verify the convergence of the proposed algorithm and demonstrate the performance gains and robustness of the proposed design compared with benchmarks.


title: A solution to the permalloy problem

abstract: We propose a solution to the longstanding permalloy problem$-$why the particular composition of permalloy, Fe$_{21.5}$Ni$_{78.5}$, achieves a dramatic drop in hysteresis, while its material constants show no obvious signal of this behavior. We use our recently developed coercivity tool to show that a delicate balance between local instabilities and magnetic material constants are necessary to explain the dramatic drop of hysteresis at 78.5% Ni. Our findings are in agreement with the permalloy experiments and, more broadly, provide theoretical guidance for the discovery of novel low hysteresis magnetic alloys.


title: Weakly Supervised Learning for Facial Behavior Analysis : A Review

abstract: In the recent years, there has been a shift in facial behavior analysis from the laboratory-controlled conditions to the challenging in-the-wild conditions due to the superior performance of deep learning based approaches for many real world applications.However, the performance of deep learning approaches relies on the amount of training data. One of the major problems with data acquisition is the requirement of annotations for large amount of training data. Labeling process of huge training data demands lot of human support with strong domain expertise for facial expressions or action units, which is difficult to obtain in real-time environments.Moreover, labeling process is highly vulnerable to ambiguity of expressions or action units, especially for intensities due to the bias induced by the domain experts. Therefore, there is an imperative need to address the problem of facial behavior analysis with weak annotations. In this paper, we provide a comprehensive review of weakly supervised learning (WSL) approaches for facial behavior analysis with both categorical as well as dimensional labels along with the challenges and potential research directions associated with it. First, we introduce various types of weak annotations in the context of facial behavior analysis and the corresponding challenges associated with it. We then systematically review the existing state-of-the-art approaches and provide a taxonomy of these approaches along with their insights and limitations. In addition, widely used data-sets in the reviewed literature and the performance of these approaches along with evaluation principles are summarized. Finally, we discuss the remaining challenges and opportunities along with the potential research directions in order to apply facial behavior analysis with weak labels in real life situations.


title: Neutron reflectometry with registration of secondary radiation

abstract: Neutron reflectometry is a method for measuring the spatial profile of the neutron interaction potential with the medium. The interaction potential is the sum of neutron interaction potentials with separate isotopes of the medium. To determine the neutron interaction potential with the structure units, secondary radiation is simultaneously registered with neutrons. Channels for registering secondary radiation of charged particles, gamma rays and neutrons, having experienced spin flip, have been developed on the REMUR spectrometer of the IBR-2 reactor in Dubna (Russia). The necessity of registering secondary radiation in neutron reflectometry is justified, a method developed for measuring secondary radiation is described and the results of testing channels for registering secondary radiation on the REMUR spectrometer are presented in the paper.


title: A conjecture concerning the $q$-Onsager algebra

abstract: The $q$-Onsager algebra $\mathcal O_q$ is defined by two generators $W_0, W_1$ and two relations called the $q$-Dolan/Grady relations. Recently Baseilhac and Kolb obtained a PBW basis for $\mathcal O_q$ with elements denoted $\lbrace B_{n \delta+ \alpha_0} \rbrace_{n=0}^\infty, \lbrace B_{n \delta+ \alpha_1} \rbrace_{n=0}^\infty, \lbrace B_{n \delta} \rbrace_{n=1}^\infty $. In their recent study of a current algebra $\mathcal A_q$, Baseilhac and Belliard conjecture that there exist elements $\lbrace W_{-k}\rbrace_{k=0}^\infty, \lbrace W_{k+1}\rbrace_{k=0}^\infty, \lbrace G_{k+1} \rbrace_{k=0}^\infty, \lbrace {\tilde G}_{k+1} \rbrace_{k=0}^\infty$ in $\mathcal O_q$ that satisfy the defining relations for $\mathcal A_q$. In order to establish this conjecture, it is desirable to know how the elements in the second list above are related to the elements in the first list above. In the present paper, we conjecture the precise relationship and give some supporting evidence. This evidence consists of some computer checks on SageMath due to Travis Scrimshaw, and a proof of our conjecture for a homomorphic image of $\mathcal O_q$ called the universal Askey-Wilson algebra.


title: A uniformizable spherical CR structure on a two-cusped hyperbolic 3-manifold

abstract: Let $\langle I_{1}, I_{2}, I_{3}\rangle$ be the complex hyperbolic $(4,4,\infty)$ triangle group. In this paper we give a proof of a conjecture of Schwartz for $\langle I_{1}, I_{2}, I_{3}\rangle$. That is $\langle I_{1}, I_{2}, I_{3}\rangle$ is discrete and faithful if and only if $I_1I_3I_2I_3$ is nonelliptic. When $I_1I_3I_2I_3$ is parabolic, we show that the even subgroup $\langle I_2 I_3, I_2I_1 \rangle$ is the holonomy representation of a uniformizable spherical CR structure on the two-cusped hyperbolic 3-manifold $s782$ in SnapPy notation.


title: Constraints on the minimally extended varying speed of light model using the Pantheon+ dataset

abstract: In the context of the minimally extended varying speed of light (meVSL) model, both the absolute magnitude and the luminosity distance of type Ia supernovae (SNe Ia) deviate from those predicted by general relativity (GR). Using data from the Pantheon$+$ survey, we assess the plausibility of various dark energy models within the framework of meVSL. Both the constant equation of state (EoS) of the dark energy model ($\omega$CDM) and the Chevallier-Polarski-Linder (CPL) parameterization model ($\omega = \omega_0 + \omega_a (1-a)$) indicate potential variations in the cosmic speed of light at the 1-$\sigma$ confidence level. For $\Omega_{\m0} = 0.30, 0.31$, and 0.32 with $(\omega_0 \,, \omega_a) = (-1 \,, 0)$, the 1-$\sigma$ range of $\dot{c}_0/c_0 \, (10^{-13} \, \text{yr}^{-1}) $ is (-8.76 \,, -0.89), (-11.8 \,, 3.93), and (-14.8 \,, -6.98), respectively. Meanwhile, the 1-$\sigma$ range of $\dot{c}_0/c_0 (10^{-12} \, \text{yr}^{-1}) $ for CPL dark energy models with $-1.05 \leq \omega_{0} \leq -0.95$ and $0.28 \leq \Omega_{\m0} \leq 0.32$, is (-6.31\,, -2.98). The value of $c$ at $z = 3$ can exceed that of the present by $0.2 \sim 3$ \% for $\omega$CDM models and $5 \sim 13$ \% for CPL models. Additionally, for viable models except for the CPL model with $\Omega_{\m0} = 0.28$, we find $-25.6 \leq \dot{G}_0/G_0 \, (10^{-12} \, \text{yr}^{-1}) \leq -0.36$. For this particular model, we obtain an increasing rate of the gravitational constant within the range $1.65 \leq \dot{G}_0/G_0 \, (10^{-12} \, \text{yr}^{-1}) \leq 3.79$. We obtained some models that do not require dark matter energy density through statistical interpretation. However, this is merely an effect of the degeneracy between model parameters and energy density and does not imply that dark matter is unnecessary.


title: A Data-Driven Modeling Framework of Time-Dependent Switched Dynamical Systems via Extreme Learning Machine

abstract: In this work, a data-driven modeling framework of switched dynamical systems under time-dependent switching is proposed. The learning technique utilized to model system dynamics is Extreme Learning Machine (ELM). First, a method is developed for the detection of the switching occurrence events in the training data extracted from system traces. The training data thus can be segmented by the detected switching instants. Then, ELM is used to learn the system dynamics of subsystems. The learning process includes segmented trace data merging and subsystem dynamics modeling. Due to the specific learning structure of ELM, the modeling process is formulated as an iterative Least-Squares (LS) optimization problem. Finally, the switching sequence can be reconstructed based on the switching detection and segmented trace merging results. An example of the data-driven modeling DC-DC converter is presented to show the effectiveness of the developed approach.


title: Applications of Deep Learning in Fundus Images: A Review

abstract: The use of fundus images for the early screening of eye diseases is of great clinical importance. Due to its powerful performance, deep learning is becoming more and more popular in related applications, such as lesion segmentation, biomarkers segmentation, disease diagnosis and image synthesis. Therefore, it is very necessary to summarize the recent developments in deep learning for fundus images with a review paper. In this review, we introduce 143 application papers with a carefully designed hierarchy. Moreover, 33 publicly available datasets are presented. Summaries and analyses are provided for each task. Finally, limitations common to all tasks are revealed and possible solutions are given. We will also release and regularly update the state-of-the-art results and newly-released datasets at https://github.com/nkicsl/Fundus Review to adapt to the rapid development of this field.


title: ECOL-R: Encouraging Copying in Novel Object Captioning with Reinforcement Learning

abstract: Novel Object Captioning is a zero-shot Image Captioning task requiring describing objects not seen in the training captions, but for which information is available from external object detectors. The key challenge is to select and describe all salient detected novel objects in the input images. In this paper, we focus on this challenge and propose the ECOL-R model (Encouraging Copying of Object Labels with Reinforced Learning), a copy-augmented transformer model that is encouraged to accurately describe the novel object labels. This is achieved via a specialised reward function in the SCST reinforcement learning framework (Rennie et al., 2017) that encourages novel object mentions while maintaining the caption quality. We further restrict the SCST training to the images where detected objects are mentioned in reference captions to train the ECOL-R model. We additionally improve our copy mechanism via Abstract Labels, which transfer knowledge from known to novel object types, and a Morphological Selector, which determines the appropriate inflected forms of novel object labels. The resulting model sets new state-of-the-art on the nocaps (Agrawal et al., 2019) and held-out COCO (Hendricks et al., 2016) benchmarks.


title: Supervision by Registration and Triangulation for Landmark Detection

abstract: We present Supervision by Registration and Triangulation (SRT), an unsupervised approach that utilizes unlabeled multi-view video to improve the accuracy and precision of landmark detectors. Being able to utilize unlabeled data enables our detectors to learn from massive amounts of unlabeled data freely available and not be limited by the quality and quantity of manual human annotations. To utilize unlabeled data, there are two key observations: (1) the detections of the same landmark in adjacent frames should be coherent with registration, i.e., optical flow. (2) the detections of the same landmark in multiple synchronized and geometrically calibrated views should correspond to a single 3D point, i.e., multi-view consistency. Registration and multi-view consistency are sources of supervision that do not require manual labeling, thus it can be leveraged to augment existing training data during detector training. End-to-end training is made possible by differentiable registration and 3D triangulation modules. Experiments with 11 datasets and a newly proposed metric to measure precision demonstrate accuracy and precision improvements in landmark detection on both images and video. Code is available at https://github.com/D-X-Y/landmark-detection.


title: Flow decomposition for heat equations with memory

abstract: We build up a decomposition for the flow generated by the heat equation with a real analytic memory kernel. It consists of three components: The first one is of parabolic nature; the second one gathers the hyperbolic component of the dynamics, with null velocity of propagation; the last one exhibits a finite smoothing effect. This decomposition reveals the hybrid parabolic-hyperbolic nature of the flow and clearly illustrates the significant impact of the memory term on the parabolic behavior of the system in the absence of memory terms.


title: CPT: Efficient Deep Neural Network Training via Cyclic Precision

abstract: Low-precision deep neural network (DNN) training has gained tremendous attention as reducing precision is one of the most effective knobs for boosting DNNs' training time/energy efficiency. In this paper, we attempt to explore low-precision training from a new perspective as inspired by recent findings in understanding DNN training: we conjecture that DNNs' precision might have a similar effect as the learning rate during DNN training, and advocate dynamic precision along the training trajectory for further boosting the time/energy efficiency of DNN training. Specifically, we propose Cyclic Precision Training (CPT) to cyclically vary the precision between two boundary values which can be identified using a simple precision range test within the first few training epochs. Extensive simulations and ablation studies on five datasets and eleven models demonstrate that CPT's effectiveness is consistent across various models/tasks (including classification and language modeling). Furthermore, through experiments and visualization we show that CPT helps to (1) converge to a wider minima with a lower generalization error and (2) reduce training variance which we believe opens up a new design knob for simultaneously improving the optimization and efficiency of DNN training. Our codes are available at: https://github.com/RICE-EIC/CPT.


title: Black Feminist Musings on Algorithmic Oppression

abstract: This paper unapologetically reflects on the critical role that Black feminism can and should play in abolishing algorithmic oppression. Positioning algorithmic oppression in the broader field of feminist science and technology studies, I draw upon feminist philosophical critiques of science and technology and discuss histories and continuities of scientific oppression against historically marginalized people. Moreover, I examine the concepts of invisibility and hypervisibility in oppressive technologies a l\'a the canonical double bind. Furthermore, I discuss what it means to call for diversity as a solution to algorithmic violence, and I critique dialectics of the fairness, accountability, and transparency community. I end by inviting you to envision and imagine the struggle to abolish algorithmic oppression by abolishing oppressive systems and shifting algorithmic development practices, including engaging our communities in scientific processes, centering marginalized communities in design, and consensual data and algorithmic practices.


title: Joint Denoising and Demosaicking with Green Channel Prior for Real-world Burst Images

abstract: Denoising and demosaicking are essential yet correlated steps to reconstruct a full color image from the raw color filter array (CFA) data. By learning a deep convolutional neural network (CNN), significant progress has been achieved to perform denoising and demosaicking jointly. However, most existing CNN-based joint denoising and demosaicking (JDD) methods work on a single image while assuming additive white Gaussian noise, which limits their performance on real-world applications. In this work, we study the JDD problem for real-world burst images, namely JDD-B. Considering the fact that the green channel has twice the sampling rate and better quality than the red and blue channels in CFA raw data, we propose to use this green channel prior (GCP) to build a GCP-Net for the JDD-B task. In GCP-Net, the GCP features extracted from green channels are utilized to guide the feature extraction and feature upsampling of the whole image. To compensate for the shift between frames, the offset is also estimated from GCP features to reduce the impact of noise. Our GCP-Net can preserve more image structures and details than other JDD methods while removing noise. Experiments on synthetic and real-world noisy images demonstrate the effectiveness of GCP-Net quantitatively and qualitatively.


title: Asymptotic Normality for the Size of Graph Tries built from M-ary Tree Labelings

abstract: Graph tries are a new and interesting data structure proposed by Jacquet in 2014. They generalize the classical trie data structure which has found many applications in computer science and is one of the most popular data structure on words. For his generalization, Jacquet considered the size (or space requirement) and derived an asymptotic expansion for the mean and the variance when graph tries are built from $n$ independently chosen random labelings of a rooted $M$-ary tree. Moreover, he conjectured a central limit theorem for the (suitably normalized) size as the number of labelings tends to infinity. In this paper, we verify this conjecture with the method of moments.


title: Chow's Theorem Revisited

abstract: We present a proof of Chow's theorem using two results of Errett Bishop retated to volumes and limits of analytic varieties. We think this approach suggested a long time ago in the beautiful book by Gabriel Stolzenberg, is very attractive and easier for students and newcomers to understand, also the theory presented here is linked to areas of mathematics that are not usually associated with Chow's theorem. Furthermore, Bishop's results imply both Chow's and Remmert-Stein's theorems directly, meaning that this approach is more economic and just as profound as Remmert-Stein's proof. At the end of the paper there is a comparison table that explains how Bishop's theorems generalize to several complex variables classical results of one complex variable.


title: A full configuration interaction quantum Monte Carlo study of ScO, TiO and VO molecules

abstract: Accurate ab initio calculations of 3d transition metal monoxide molecules have attracted extensive attention because of its relevance in physical and chemical science, as well as theoretical challenges in treating strong electron correlation. Meanwhile, recent years have witnessed the rapid development of full configuration interaction quantum Monte Carlo (FCIQMC) method to tackle electron correlation. In this study, we carry out FCIQMC simulations to ScO, TiO and VO molecules and obtain accurate descriptions of 13 low-lying electronic states (ScO $^2\Sigma^+$, $^2\Delta$, $^2\Pi$; TiO $^3\Delta$, $^1\Delta$, $^1\Sigma^+$, $^3\Pi$, $^3\Phi$; VO $^4\Sigma^-$, $^4\Phi$, $^4\Pi$, $^2\Gamma$, $^2\Delta$), including states that have significant multi-configurational character. The FCIQMC results are used to assess the performance of several other wave function theory and density functional theory methods. Our study highlights the challenging nature of electronic structure of transition metal oxides and demonstrates FCIQMC as a promising technique going forward to treat more complex transition metal oxide molecules and materials.


title: Transport properties in magnetized compact stars

abstract: Transport properties of dense quark matter are discussed in the strong magnetic field, B. B dependence as well as density dependence of the Hall conductivity is discussed in the inhomogeneous chiral phase. Anomalous Hall effect is intrinsic to the inhomogeneous chiral phase and resembles the one in Weyl semimetals in condensed matter physics. Some theoretical aspects inherent in anomalous Hall effect are revealed.


title: Eigen-convergence of Gaussian kernelized graph Laplacian by manifold heat interpolation

abstract: This work studies the spectral convergence of graph Laplacian to the Laplace-Beltrami operator when the graph affinity matrix is constructed from $N$ random samples on a $d$-dimensional manifold embedded in a possibly high dimensional space. By analyzing Dirichlet form convergence and constructing candidate approximate eigenfunctions via convolution with manifold heat kernel, we prove that, with Gaussian kernel, one can set the kernel bandwidth parameter $\epsilon \sim (\log N/ N)^{1/(d/2+2)}$ such that the eigenvalue convergence rate is $N^{-1/(d/2+2)}$ and the eigenvector convergence in 2-norm has rate $N^{-1/(d+4)}$; When $\epsilon \sim (\log N/N)^{1/(d/2+3)}$, both eigenvalue and eigenvector rates are $N^{-1/(d/2+3)}$. These rates are up to a $\log N$ factor and proved for finitely many low-lying eigenvalues. The result holds for un-normalized and random-walk graph Laplacians when data are uniformly sampled on the manifold, as well as the density-corrected graph Laplacian (where the affinity matrix is normalized by the degree matrix from both sides) with non-uniformly sampled data. As an intermediate result, we prove new point-wise and Dirichlet form convergence rates for the density-corrected graph Laplacian. Numerical results are provided to verify the theory.


title: A universal Cannon-Thurston map and the surviving curve complex

abstract: Using the Birmanexact sequence for pure mapping class groups, we construct a universal Cannon--Thurston map onto the boundary of a curve complex for a surface with punctures we call surviving curve complex. Along the way we prove hyperbolicity of this complex and identify its boundary as a space of laminations. As a corollary we obtain a universal Cannon--Thurston map to the boundary of the ordinary curve complex, extending earlier work of the second author with Mj and Schleimer.


title: TSO-DSO Operational Planning Coordination through "$l_1$-Proximal" Surrogate Lagrangian Relaxation

abstract: The proliferation of distributed energy resources (DERs), located at the Distribution System Operator (DSO) level, bring new opportunities as well as new challenges to the operations within the grid, specifically, when it comes to the interaction with the Transmission System Operator (TSO). To enable interoperability, while ensuring higher flexibility and cost-efficiency, DSOs and the TSO need to be efficiently coordinated. Difficulties behind creating such TSO-DSO coordination include the combinatorial nature of the operational planning problem involved at the transmission level as well as the nonlinearity of AC power flow within both systems. These considerations significantly increase the complexity even under the deterministic setting. In this paper, a deterministic TSO-DSO operational planning coordination problem is considered and a novel decomposition and coordination approach is developed. Within the new method, the problem is decomposed into TSO and DSO subproblems, which are efficiently coordinated by updating Lagrangian multipliers. The nonlinearities at the TSO level caused by AC power flow constraints are resolved through a dynamic linearization while guaranteeing feasibility through "$l_1$-proximal" terms. Numerical results based on the coordination of the 118-bus TSO system with up to 32 DSO 34-bus systems indicate that the method efficiently overcomes the computational difficulties of the problem.


title: Federated Intrusion Detection for IoT with Heterogeneous Cohort Privacy

abstract: Internet of Things (IoT) devices are becoming increasingly popular and are influencing many application domains such as healthcare and transportation. These devices are used for real-world applications such as sensor monitoring, real-time control. In this work, we look at differentially private (DP) neural network (NN) based network intrusion detection systems (NIDS) to detect intrusion attacks on networks of such IoT devices. Existing NN training solutions in this domain either ignore privacy considerations or assume that the privacy requirements are homogeneous across all users. We show that the performance of existing differentially private stochastic methods degrade for clients with non-identical data distributions when clients' privacy requirements are heterogeneous. We define a cohort-based $(\epsilon,\delta)$-DP framework that models the more practical setting of IoT device cohorts with non-identical clients and heterogeneous privacy requirements. We propose two novel continual-learning based DP training methods that are designed to improve model performance in the aforementioned setting. To the best of our knowledge, ours is the first system that employs a continual learning-based approach to handle heterogeneity in client privacy requirements. We evaluate our approach on real datasets and show that our techniques outperform the baselines. We also show that our methods are robust to hyperparameter changes. Lastly, we show that one of our proposed methods can easily adapt to post-hoc relaxations of client privacy requirements.


title: Finite-time convergence of solutions of Hamilton-Jacobi equations

abstract: Suppose that $H(x,u,p)$ is strictly decreasing in $u$ and satisfies Tonelli conditions in $p$. We show that each viscosity solution of $H(x,u,u_x)=0$ can be reached by many viscosity solutions of $$ w_t+H(x,w,w_x)=0, $$ in a finite time.


title: Modeling interfacial phonon transport with normal mode dynamics

abstract: Traditional theories of interfacial heat transfer by atomic vibrations, also known as phonons, do not explain how vibrational mode interactions contribute to interface conductance. Traditional methods also use the concept of phonons as particles or waves which propagate and transmit energy through interfaces; such methods are therefore inapplicable to realistic non-crystalline systems where phonons are not propagating. Here we introduce a more general formalism of interfacial phonon transport, rigorously derived from interatomic interactions projected onto the normal modes of the system, showing for the first time how interactions between vibrational modes contribute to thermal interface conductance. This new physical picture is based on the concept of forces and energy exchange between modes, regardless of their propagating or non-propagating character, thus providing a general formalism to describe phonon transport in all solids regardless of disorder.


title: Comparison properties of asymptotically tracially approximation C*-algebras

abstract: We show that the following properties of the C*-algebras in a class $\mathcal{P}$ are inherited by simple unital ${\rm C^*}$-algebras in the class of asymptotically tracially in $\mathcal{P}$: $(1)$ $\beta$-comparison (in the sense of Kirchberg and R{\o}rdam), $(2)$ $n$-comparison (in the sense of Winter).


title: Role of Majorana Fermions in high-harmonic generation from Kitaev chain

abstract: The observation of Majorana fermions as collective excitations in condensed-matter systems is an ongoing quest, and several state-of-the-art experiments have been performed in the last decade. As a potential avenue in this direction, we simulate the high-harmonic spectrum of Kitaev's superconducting chain model that hosts Majorana edge modes in its topological phase. It is well-known that this system exhibits a topological--trivial superconducting phase transition. We demonstrate that high-harmonic spectroscopy is sensitive to the phase transition in presence of open boundary conditions due to the presence or absence of these edge modes. The population dynamics of the Majorana edge modes are different from the bulk modes, which is the underlying reason for the distinct harmonic profile of both the phases. On the contrary, in presence of periodic boundary conditions with only bulk modes, high-harmonic spectroscopy becomes insensitive to the phase transition with similar harmonic profiles in both phases.

categories: cond-mat.str-el cond-mat.mes-hall cond-mat.supr-con physics.atom-ph physics.optics


title: Antiferromagnetic State in $\kappa$-type Molecular Conductors: Spin Splitting and Mott Gap

abstract: We numerically investigate the dynamical properties of $\kappa$-type molecular conductors in their antiferromagnetic Mott insulating state. By treating the extended Hubbard model on the two-dimensional $\kappa$-type lattice within the Lanzcos exact diagonalization method, we calculate the one-particle spectral function $A(\boldsymbol{k}, \omega)$ and the optical absorption spectra taking advantage of twisted boundary conditions. We find spin splitting in $A(\boldsymbol{k}, \omega)$ predicted by a previous Hartree-Fock study [M. Naka et al., Nat. Commun. 10, 4305 (2019)]; namely, their up- and down-spin components become different in the general $\boldsymbol{k}$-points of the Brillouin zone, even without the spin-orbit coupling. Furthermore, we demonstrate the variation in the optical properties near the Mott gap by the presence or absence of the antiferromagnetic order, tuned by a small staggered magnetic field.


title: Domain-Dependent Speaker Diarization for the Third DIHARD Challenge

abstract: This report presents the system developed by the ABSP Laboratory team for the third DIHARD speech diarization challenge. Our main contribution in this work is to develop a simple and efficient solution for acoustic domain dependent speech diarization. We explore speaker embeddings for \emph{acoustic domain identification} (ADI) task. Our study reveals that i-vector based method achieves considerably better performance than x-vector based approach in the third DIHARD challenge dataset. Next, we integrate the ADI module with the diarization framework. The performance substantially improved over that of the baseline when we optimized the thresholds for agglomerative hierarchical clustering and the parameters for dimensionality reduction during scoring for individual acoustic domains. We achieved a relative improvement of $9.63\%$ and $10.64\%$ in DER for core and full conditions, respectively, for Track 1 of the DIHARD III evaluation set.


title: Active Attack Detection and Control in Constrained Cyber-Physical Systems Under Prevented Actuation Attack

abstract: This paper proposes an active attack detection scheme for constrained cyber-physical systems. Despite passive approaches where the detection is based on the analysis of the input-output data, active approaches interact with the system by designing the control input so to improve detection. This paper focuses on the prevented actuation attack, where the attacker prevents the exchange of information between the controller and actuators. The proposed scheme consists of two units: 1) detection, and 2) control. The detection unit includes a set of parallel detectors, which are designed based on the multiple-model adaptive estimation approach to detect the attack and to identify the attacked actuator(s). For what regards the control unit, a constrained optimization approach is developed to determine the control input such that the control and detection aims are achieved. In the formulation of the detection and control objective functions, a probabilistic approach is used to reap the benefits of the \textit{a priori} information availability. The effectiveness of the proposed scheme is demonstrated through a simulation study on an irrigation channel.


title: The Two-Sided Market Network Analysis Based on Transfer Entropy & Labelr

abstract: This study more complex digital platforms in early stages in the two-sided market to produce powerful network effects. In this study, I use Transfer Entropy to look for super users who connect hominids in different networks to achieve higher network effects in the digital platform in the two-sided market, which has recently become more complex. And this study also aims to redefine the decision criteria of product managers by helping them define users with stronger network effects. With the development of technology, the structure of the industry is becoming more difficult to interpret and the complexity of business logic is increasing. This phenomenon is the biggest problem that makes it difficult for start-ups to challenge themselves. I hope this study will help product managers create new digital economic networks, enable them to make prioritized, data-driven decisions, and find users who can be the hub of the network even in small products.


title: New cosmic ray observations at Syowa Station in the Antarctic for space weather study

abstract: Muon detectors and neutron monitors were recently installed at Syowa Station, in the Antarctic, to observe different types of secondary particles resulting from cosmic ray interactions simultaneously from the same location. Continuing observations will give new insight into the response of muon detectors to atmospheric and geomagnetic effects. Operation began in February, 2018 and the system has been stable with a duty-cycle exceeding 94%. Muon data shows a clear seasonal variation, which is expected from the atmospheric temperature effect. We verified successful operation by showing that the muon and neutron data are consistent with those from other locations by comparing intensity variations during a space weather event. We have established a web page to make real time data available with interactive graphics (http://polaris.nipr.ac.jp/~cosmicrays/).


title: The Araucaria Project: Deep near-infrared photometric maps of Local and Sculptor Group galaxies. I. Carina, Fornax, Sculptor

abstract: Deep near-infrared $J$- and $K$-band photometry of three Local Group dwarf spheroidal galaxies: Fornax, Carina, and Sculptor, is made available for the community. Until now, these data have only been used by the Araucaria Project to determine distances using the tip of the red giant and RR Lyrae stars. Now, we present the entire data collection in a form of a database, consisting of accurate $J$- and $K$-band magnitudes, sky coordinates, ellipticity measurements, and timestamps of observations, complemented by stars' loci in their reference images. Depth of our photometry reaches about 22 mag at 5$\sigma$ level, and is comparable to NIR surveys, like the UKIRT Infrared Deep Sky Survey (UKIDSS) or the VISTA Hemisphere Survey (VHS). Small overlap with VHS and no overlap with UKIDSS makes our database a unique source of quality photometry.


title: Non-equilibrium entropy and irreversibility in generalized stochastic Loewner evolution from an information-theoretic perspective

abstract: The generalized stochastic Loewner evolution (SLE) driven by reversible Langevin dynamics was theoretically investigated in the context of non-equilibrium statistical mechanics. The recent study of the authors revealed that the Loewner evolution enables encoding the non-equilibrium (irreversible) processes into equilibrium (reversible) processes. In this study, by Gibbs entropy-based information-theoretic approaches, we formulated this encoding mechanism of the SLE to discuss its advantages as a mean to better describe non-equilibrium states. After deriving entropy production and flux for the 2D trajectories of the generalized SLE curve, we reformulated the system's entropic properties in terms of the Kullback-Leibler (KL) divergence. We demonstrate that this operation leads to alternative expressions of the Jarzynski equality and the second law of thermodynamics, which are consistent with the previously suggested theory of information thermodynamics. The irreversibility of the 2D trajectory was likewise discussed by decomposing its entropy into additive and non-additive parts. We numerically verified the non-equilibrium property of our model by simulating the long-time behavior of the entropic measure suggested by our formulation, referred to as the relative Loewner entropy.


title: A new efficient approximation scheme for solving high-dimensional semilinear PDEs: control variate method for Deep BSDE solver

abstract: This paper introduces a new approximation scheme for solving high-dimensional semilinear partial differential equations (PDEs) and backward stochastic differential equations (BSDEs). First, we decompose a target semilinear PDE (BSDE) into two parts, namely "dominant" linear and "small" nonlinear PDEs. Then, we employ a Deep BSDE solver with a new control variate method to solve those PDEs, where approximations based on an asymptotic expansion technique are effectively applied to the linear part and also used as control variates for the nonlinear part. Moreover, our theoretical result indicates that errors of the proposed method become much smaller than those of the original Deep BSDE solver. Finally, we show numerical experiments to demonstrate the validity of our method, which is consistent with the theoretical result in this paper.


title: Possible experimental signatures of stable double beauty tetraquarks

abstract: A new method is proposed to search for the double beauty tetraquark $bb\bar{u}\bar{d}$ with a mass below the $BB$ threshold. The $b\bar{d}-\bar{b}d$ mixing can result in evolution of the tetraquark content to $b\bar{b}\bar{u}d$ with the following strong decay into the $\Upsilon$(1S)$\pi^-$ and $\Upsilon$(2S)$\pi^-$ final states in a secondary vertex displaced from the primary $pp$ collision vertex. This experimental signature is clean, has a high selection efficiency and can be well separated from backgrounds. Experimental signatures for searches for other double heavy tetraquarks are also discussed, suggesting the possibility of the $b\bar{d}$ or $b\bar{s}$ mixing.


title: Cross Knowledge-based Generative Zero-Shot Learning Approach with Taxonomy Regularization

abstract: Although zero-shot learning (ZSL) has an inferential capability of recognizing new classes that have never been seen before, it always faces two fundamental challenges of the cross modality and crossdomain challenges. In order to alleviate these problems, we develop a generative network-based ZSL approach equipped with the proposed Cross Knowledge Learning (CKL) scheme and Taxonomy Regularization (TR). In our approach, the semantic features are taken as inputs, and the output is the synthesized visual features generated from the corresponding semantic features. CKL enables more relevant semantic features to be trained for semantic-to-visual feature embedding in ZSL, while Taxonomy Regularization (TR) significantly improves the intersections with unseen images with more generalized visual features generated from generative network. Extensive experiments on several benchmark datasets (i.e., AwA1, AwA2, CUB, NAB and aPY) show that our approach is superior to these state-of-the-art methods in terms of ZSL image classification and retrieval.


title: MadDog: A Web-based System for Acronym Identification and Disambiguation

abstract: Acronyms and abbreviations are the short-form of longer phrases and they are ubiquitously employed in various types of writing. Despite their usefulness to save space in writing and reader's time in reading, they also provide challenges for understanding the text especially if the acronym is not defined in the text or if it is used far from its definition in long texts. To alleviate this issue, there are considerable efforts both from the research community and software developers to build systems for identifying acronyms and finding their correct meanings in the text. However, none of the existing works provide a unified solution capable of processing acronyms in various domains and to be publicly available. Thus, we provide the first web-based acronym identification and disambiguation system which can process acronyms from various domains including scientific, biomedical, and general domains. The web-based system is publicly available at http://iq.cs.uoregon.edu:5000 and a demo video is available at https://youtu.be/IkSh7LqI42M. The system source code is also available at https://github.com/amirveyseh/MadDog.


title: Alternating Direction Method of Multipliers-Based Parallel Optimization for Multi-Agent Collision-Free Model Predictive Control

abstract: This paper investigates the collision-free control problem for multi-agent systems. For such multi-agent systems, it is the typical situation where conventional methods using either the usual centralized model predictive control (MPC), or even the distributed counterpart, would suffer from substantial difficulty in balancing optimality and computational efficiency. Additionally, the non-convex characteristics that invariably arise in such collision-free control and optimization problems render it difficult to effectively derive a reliable solution (and also to thoroughly analyze the associated convergence properties). To overcome these challenging issues, this work establishes a suitably novel parallel computation framework through an innovative mathematical problem formulation; and then with this framework and formulation, a parallel algorithm based on alternating direction method of multipliers (ADMM) is presented to solve the sub-problems arising from the resulting parallel structure. Furthermore, an efficient and intuitive initialization procedure is developed to accelerate the optimization process, and the optimum is thus determined with significantly improved computational efficiency. As supported by rigorous proofs, the convergence of the proposed ADMM iterations for this non-convex optimization problem is analyzed and discussed in detail. Finally, a simulation with a group of unmanned aerial vehicles (UAVs) serves as an illustrative example here to demonstrate the effectiveness and efficiency of the proposed approach. Also, the simulation results verify significant improvements in accuracy and computational efficiency compared to other baselines, including primal quadratic mixed integer programming (PQ-MIP), non-convex quadratic mixed integer programming (NC-MIP), and non-convex quadratically constrained quadratic programming (NC-QCQP).


title: Spatio-temporal Data Augmentation for Visual Surveillance

abstract: Visual surveillance aims to stably detect a foreground object using a continuous image acquired from a fixed camera. Recent deep learning methods based on supervised learning show superior performance compared to classical background subtraction algorithms. However, there is still a room for improvement in static foreground, dynamic background, hard shadow, illumination changes, camouflage, etc. In addition, most of the deep learning-based methods operates well on environments similar to training. If the testing environments are different from training ones, their performance degrades. As a result, additional training on those operating environments is required to ensure a good performance. Our previous work which uses spatio-temporal input data consisted of a number of past images, background images and current image showed promising results in different environments from training, although it uses a simple U-NET structure. In this paper, we propose a data augmentation technique suitable for visual surveillance for additional performance improvement using the same network used in our previous work. In deep learning, most data augmentation techniques deal with spatial-level data augmentation techniques for use in image classification and object detection. In this paper, we propose a new method of data augmentation in the spatio-temporal dimension suitable for our previous work. Two data augmentation methods of adjusting background model images and past images are proposed. Through this, it is shown that performance can be improved in difficult areas such as static foreground and ghost objects, compared to previous studies. Through quantitative and qualitative evaluation using SBI, LASIESTA, and our own dataset, we show that it gives superior performance compared to deep learning-based algorithms and background subtraction algorithms.


title: Is Phase Shift Keying Optimal for Channels with Phase-Quantized Output?

abstract: This paper establishes the capacity of additive white Gaussian noise (AWGN) channels with phase-quantized output. We show that a rotated $2^b$-phase shift keying scheme is the capacity-achieving input distribution for a complex AWGN channel with $b$-bit phase quantization. The result is then used to establish the expression for the channel capacity as a function of average power constraint $P$ and quantization bits $b$. The outage performance of phase-quantized system is also investigated for the case of Rayleigh fading when the channel state information (CSI) is only known at the receiver. Our findings suggest the existence of a threshold in the rate $R$, above which the outage exponent of the outage probability changes abruptly. In fact, this threshold effect in the outage exponent causes $2^b$-PSK to have suboptimal outage performance at high SNR.


title: Extremal quasimodular forms of lower depth with integral Fourier coefficients

abstract: We show that, based on Grabner's recent results on modular differential equations satisfied by quasimodular forms, there exist only finitely many normalized extremal quasimodular forms of depth $r$ that have all Fourier coefficients integral for each of $r=1,2,3,4$, and partly classifies them, where the classification is complete for $r=2,3,4$; in fact, we show that there exists no normalized extremal quasimodular forms of depth $4$ with all Fourier coefficients integral. Our result disproves a conjecture by Pellarin.