title: Dream to Explore: Adaptive Simulations for Autonomous Systems

abstract: One's ability to learn a generative model of the world without supervision depends on the extent to which one can construct abstract knowledge representations that generalize across experiences. To this end, capturing an accurate statistical structure from observational data provides useful inductive biases that can be transferred to novel environments. Here, we tackle the problem of learning to control dynamical systems by applying Bayesian nonparametric methods, which is applied to solve visual servoing tasks. This is accomplished by first learning a state space representation, then inferring environmental dynamics and improving the policies through imagined future trajectories. Bayesian nonparametric models provide automatic model adaptation, which not only combats underfitting and overfitting, but also allows the model's unbounded dimension to be both flexible and computationally tractable. By employing Gaussian processes to discover latent world dynamics, we mitigate common data efficiency issues observed in reinforcement learning and avoid introducing explicit model bias by describing the system's dynamics. Our algorithm jointly learns a world model and policy by optimizing a variational lower bound of a log-likelihood with respect to the expected free energy minimization objective function. Finally, we compare the performance of our model with the state-of-the-art alternatives for continuous control tasks in simulated environments.


title: Entropy measurement of a strongly coupled quantum dot

abstract: The spin 1/2 entropy of electrons trapped in a quantum dot has previously been measured with great accuracy, but the protocol used for that measurement is valid only within a restrictive set of conditions. Here, we demonstrate a novel entropy measurement protocol that is universal for arbitrary mesoscopic circuits and apply this new approach to measure the entropy of a quantum dot hybridized with a reservoir, where Kondo correlations dominate spin physics. The experimental results match closely to numerical renormalization group (NRG) calculations for small and intermediate coupling. For the largest couplings investigated in this work, NRG predicts a suppression of spin entropy at the charge transition due to the formation of a Kondo singlet, but that suppression is not observed in the experiment.


title: Proof of some conjectural congruences of da Silva and Sellers

abstract: Let $p_{\{3, 3\}}(n)$ denote the number of $3$-regular partitions in three colours. In a very recent paper, da Silva and Sellers studied certain arithmetic properties of $p_{\{3, 3\}}(n)$. They further conjectured four Ramanujan-like congruences modulo $5$ satisfied by $p_{\{3, 3\}}(n)$. In this article, we confirm the conjectural congruences of da Silva and Sellers using the theory of modular forms.


title: Identifying the key components in ResNet-50 for diabetic retinopathy grading from fundus images: a systematic investigation

abstract: Although deep learning based diabetic retinopathy (DR) classification methods typically benefit from well-designed architectures of convolutional neural networks, the training setting also has a non-negligible impact on the prediction performance. The training setting includes various interdependent components, such as objective function, data sampling strategy and data augmentation approach. To identify the key components in a standard deep learning framework (ResNet-50) for DR grading, we systematically analyze the impact of several major components. Extensive experiments are conducted on a publicly-available dataset EyePACS. We demonstrate that (1) the DR grading framework is sensitive to input resolution, objective function, and composition of data augmentation, (2) using mean square error as the loss function can effectively improve the performance with respect to a task-specific evaluation metric, namely the quadratically-weighted Kappa, (3) utilizing eye pairs boosts the performance of DR grading and (4) using data resampling to address the problem of imbalanced data distribution in EyePACS hurts the performance. Based on these observations and an optimal combination of the investigated components, our framework, without any specialized network design, achieves the state-of-the-art result (0.8631 for Kappa) on the EyePACS test set (a total of 42670 fundus images) with only image-level labels. We also examine the proposed training practices on other fundus datasets and other network architectures to evaluate their generalizability. Our codes and pre-trained model are available at https://github.com/YijinHuang/pytorch-classification.


title: Particle dark matter density and entropy production in the early universe

abstract: Dark Matter (DM) density is reduced if entropy production takes place after DM particles abundance is frozen out in the early universe. We study a possibility of such reduction due to entropy production in the electroweak phase transition (EWPT). We compare scenarios of entropy production in the standard model (SM) and its simplest extension, the two-Higgs doublet model (2HDM). Assuming the EWPT is of second order in the SM scenario and the first order in the 2HDM, we calculate the entropy release in these scenarios and the corresponding dilution of preexisting DM density in the early universe. We find the effect of dilution in EWPT significant for confrontation with observations of any form of possible DM (including primordial black holes (PBHs)), which is frozen out, decoupled, frozen in, or formed before EWPT.


title: Stubbifier: Debloating Dynamic Server-Side JavaScript Applications

abstract: JavaScript is an increasingly popular language for server-side development, thanks in part to the Node.js runtime environment and its vast ecosystem of modules. With the Node.js package manager npm, users are able to easily include external modules as dependencies in their projects. However, npm installs modules with all of their functionality, even if only a fraction is needed, which causes an undue increase in code size. Eliminating this unused functionality from distributions is desirable, but the sound analysis required to find unused code is difficult due to JavaScript's extreme dynamicity. We present a fully automatic technique that identifies unused code by constructing static or dynamic call graphs from the application's tests, and replacing code deemed unreachable with either file- or function-level stubs. If a stub is called, it will fetch and execute the original code on-demand, thus relaxing the requirement that the call graph be sound. The technique also provides an optional guarded execution mode to guard application against injection vulnerabilities in untested code that resulted from stub expansion. This technique is implemented in an open source tool called Stubbifier, which supports the ECMAScript 2019 standard. In an empirical evaluation on 15 Node.js applications and 75 clients of these applications, Stubbifier reduced application size by 56% on average while incurring only minor performance overhead. The evaluation also shows that Stubbifier's guarded execution mode is capable of preventing several known injection vulnerabilities that are manifested in stubbed-out code. Finally, Stubbifier can work alongside bundlers, popular JavaScript tools for bundling an application with its dependencies. For the considered subject applications, we measured an average size reduction of 37% in bundled distributions.


title: Does the Data Induce Capacity Control in Deep Learning?

abstract: We show that the input correlation matrix of typical classification datasets has an eigenspectrum where, after a sharp initial drop, a large number of small eigenvalues are distributed uniformly over an exponentially large range. This structure is mirrored in a network trained on this data: we show that the Hessian and the Fisher Information Matrix (FIM) have eigenvalues that are spread uniformly over exponentially large ranges. We call such eigenspectra "sloppy" because sets of weights corresponding to small eigenvalues can be changed by large magnitudes without affecting the loss. Networks trained on atypical datasets with non-sloppy inputs do not share these traits and deep networks trained on such datasets generalize poorly. Inspired by this, we study the hypothesis that sloppiness of inputs aids generalization in deep networks. We show that if the Hessian is sloppy, we can compute non-vacuous PAC-Bayes generalization bounds analytically. By exploiting our empirical observation that training predominantly takes place in the non-sloppy subspace of the FIM, we develop data-distribution dependent PAC-Bayes priors that lead to accurate generalization bounds using numerical optimization.


title: Don't read, just look: Main content extraction from web pages using visual features

abstract: Extracting main content from web pages provides primary informative blocks that remove a web page's minor areas like navigation menu, ads, and site templates. The main content extraction has various applications: information retrieval, search engine optimization, and browser reader mode. We assessed the existing four main content extraction methods (Readability.js, Chrome DOM Distiller, Web2Text, and Boilernet) with the web pages of two English datasets from global websites of 2017 and 2020 and seven non-English datasets by languages of 2020. Its result showed that performance was lower by up to 40% in non-English datasets than in English datasets. Thus, this paper proposes a multilingual main content extraction method using visual features: the elements' positions, size, and distances from three centers. These centers were derived from the browser window, web document, and the first browsing area. We propose this first browsing area, which is the top side of a web document for simulating situations where a user first encountered a web page. Because web page authors placed their main contents in the central area for the web page's usability, we can assume the center of this area is close to the main content. Our grid-centering-expanding (GCE) method suggests the three centroids as hypothetical user foci. Traversing the DOM tree from each of the leaf nodes closest to these centroids, our method inspects which the ancestor node can be the main content candidate. Finally, it extracts the main content by selecting the best among the three main content candidates. Our method performed 14% better than the existing method on average in Longest Common Subsequence F1 score. In particular, it improved performance by up to 25% in the English dataset and 16% in the non-English dataset. Therefore, our method showed the visual and basic HTML features are effective in extracting the main content.


title: Atomic and entanglement dynamics in the mixed squeezed coherent state version of the Jaynes-Cummings interaction

abstract: The main objective of this work is to study the Jaynes-Cummings model interaction of a two-level atom interacting with a mixed field state of a squeezed vacuum and a coherent state. Here, the pure squeezed coherent state (PSCS) and the mixed squeezed coherent state (MSCS) have been used as the states of the radiation field. The photon-counting distribution (PCD), the atomic inversion and the entanglement dynamics of atom-field interaction for both the radiation fields are investigated and compared with each other. We observe that depending on the state of the field, squeezing has very different effects on coherent photons. Mild squeezing on the coherent photons localizes the PCD for PSCS; however, for MSCS there is no such localization observed - instead squeezing manifests for MSCS as oscillations in the PCD. The effects of squeezing on the atomic inversion and the entanglement dynamics for PSCS are very different as compared with the corresponding quantities associated with MSCS; in fact, they are contrasting. It is well known in the literature that for PSCS, increasing the squeezing increases the well-known ringing revivals in the atomic inversion, and also increases irregularity in the entanglement dynamics. However, increasing the squeezing in MSCS very significantly alters the collapse-revival pattern in the atomic inversion and the entanglement dynamics of the Jaynes-Cummings model. For MSCS, the effect of squeezing on the quadrature variables and Mandel's $Q$ parameter are also presented.


title: A Self-adaptive Weighted Differential Evolution Approach for Large-scale Feature Selection

abstract: Recently, many evolutionary computation methods have been developed to solve the feature selection problem. However, the studies focused mainly on small-scale issues, resulting in stagnation issues in local optima and numerical instability when dealing with large-scale feature selection dilemmas. To address these challenges, this paper proposes a novel weighted differential evolution algorithm based on self-adaptive mechanism, named SaWDE, to solve large-scale feature selection. First, a multi-population mechanism is adopted to enhance the diversity of the population. Then, we propose a new self-adaptive mechanism that selects several strategies from a strategy pool to capture the diverse characteristics of the datasets from the historical information. Finally, a weighted model is designed to identify the important features, which enables our model to generate the most suitable feature-selection solution. We demonstrate the effectiveness of our algorithm on twelve large-scale datasets. The performance of SaWDE is superior compared to six non-EC algorithms and six other EC algorithms, on both training and test datasets and on subset size, indicating that our algorithm is a favorable tool to solve the large-scale feature selection problem. Moreover, we have experimented SaWDE with six EC algorithms on twelve higher-dimensional data, which demonstrates that SaWDE is more robust and efficient compared to those state-of-the-art methods. SaWDE source code is available on Github at https://github.com/wangxb96/SaWDE.


title: Multivariate Dynamical Sampling in $l^2(\mathbb{Z}^2)$ and Shift-Invariant Spaces Associated with Linear Canonical Transform

abstract: In this paper, we investigate the multivariate dynamical sampling problem in $l^2(\mathbb{Z}^2)$ associated with the two-dimensional discrete time non-separable linear canonical transform (2D-DT-NS-LCT) and shift-invariant spaces associated with the two-dimensional non-separable linear canonical transform (2D-NS-LCT), respectively. Specifically, we derive a sufficient and necessary condition under which a sequence in $l^2(\mathbb{Z}^2)$ (or a function in a shift-invariant space) can be stably recovered from its dynamical sampling measurements associated with the 2D-DT-NS-LCT (or the 2D-NS-LCT). We also present a simple example to elucidate our main results.


title: Training Verifiers to Solve Math Word Problems

abstract: State-of-the-art language models can match human performance on many tasks, but they still struggle to robustly perform multi-step mathematical reasoning. To diagnose the failures of current models and support research, we introduce GSM8K, a dataset of 8.5K high quality linguistically diverse grade school math word problems. We find that even the largest transformer models fail to achieve high test performance, despite the conceptual simplicity of this problem distribution. To increase performance, we propose training verifiers to judge the correctness of model completions. At test time, we generate many candidate solutions and select the one ranked highest by the verifier. We demonstrate that verification significantly improves performance on GSM8K, and we provide strong empirical evidence that verification scales more effectively with increased data than a finetuning baseline.


title: Control of a Floating Wind Turbine on a Novel Actuated Platform

abstract: Designing a floating offshore wind turbine (FOWT) controller requires solving engineering challenges not found for fixed-bottom turbines. This paper applies several methods from the growing body of FOWT control literature to the 10-MW Ultraflexible Smart FLoating Offshore Wind Turbine (USFLOWT) baseline generator-speed controller. USFLOWT aims to reduce capital expenses using the lightweight SpiderFLOAT platform, a novel smart floating substructure with built-in distributed actuators for direct platform tilt and heave control. In this work, the USFLOWT baseline controller is improved through detuning and parallel compensation with both blade pitch and generator torque. The SpiderFLOAT platform additionally allows motion compensation through distributed platform actuators. Two proposed SpiderFLOAT actuator types are considered for active platform control: a low-bandwidth actuator that uses variable floater ballast to bring a heeling platform to a steady-state upright position, and a high-bandwidth actuator that dynamically changes the substructure geometry to actively reject transient platform motion. Each control approach is tested for USFLOWT using the open-source aero-hydro-servo-elastic wind turbine simulation tool OpenFAST. Performance results for each approach are compared across a range of above-rated wind speeds, and promising combined approaches are further evaluated to recommend future multi-parameter optimization pathways.


title: Meta-Knowledge Transfer for Inductive Knowledge Graph Embedding

abstract: Knowledge graphs (KGs) consisting of a large number of triples have become widespread recently, and many knowledge graph embedding (KGE) methods are proposed to embed entities and relations of a KG into continuous vector spaces. Such embedding methods simplify the operations of conducting various in-KG tasks (e.g., link prediction) and out-of-KG tasks (e.g., question answering). They can be viewed as general solutions for representing KGs. However, existing KGE methods are not applicable to inductive settings, where a model trained on source KGs will be tested on target KGs with entities unseen during model training. Existing works focusing on KGs in inductive settings can only solve the inductive relation prediction task. They can not handle other out-of-KG tasks as general as KGE methods since they don't produce embeddings for entities. In this paper, to achieve inductive knowledge graph embedding, we propose a model MorsE, which does not learn embeddings for entities but learns transferable meta-knowledge that can be used to produce entity embeddings. Such meta-knowledge is modeled by entity-independent modules and learned by meta-learning. Experimental results show that our model significantly outperforms corresponding baselines for in-KG and out-of-KG tasks in inductive settings.


title: Diversity Enhanced Active Learning with Strictly Proper Scoring Rules

abstract: We study acquisition functions for active learning (AL) for text classification. The Expected Loss Reduction (ELR) method focuses on a Bayesian estimate of the reduction in classification error, recently updated with Mean Objective Cost of Uncertainty (MOCU). We convert the ELR framework to estimate the increase in (strictly proper) scores like log probability or negative mean square error, which we call Bayesian Estimate of Mean Proper Scores (BEMPS). We also prove convergence results borrowing techniques used with MOCU. In order to allow better experimentation with the new acquisition functions, we develop a complementary batch AL algorithm, which encourages diversity in the vector of expected changes in scores for unlabelled data. To allow high performance text classifiers, we combine ensembling and dynamic validation set construction on pretrained language models. Extensive experimental evaluation then explores how these different acquisition functions perform. The results show that the use of mean square error and log probability with BEMPS yields robust acquisition functions, which consistently outperform the others tested.


title: A robust protocol for entropy measurement in mesoscopic circuits

abstract: Previous measurements utilizing Maxwell relations to measure change in entropy, $S$, demonstrated remarkable accuracy of measuring the spin-1/2 entropy of electrons in a weakly coupled quantum dot. However, these previous measurements relied upon prior knowledge of the charge transition lineshape. This had the benefit of making the determination of entropy independent of measurement scaling, but at the cost of limiting the applicability of the approach to relatively simple systems. To measure entropy of more exotic mesoscopic systems, a new analysis technique can be employed; however, doing so requires precise knowledge of the measurement scaling. Here, we give details on the necessary improvements made to the original experimental approach and highlight some of the common challenges (along with strategies to overcome them) that other groups may face when attempting this type of measurement.


title: A characterization of normality via convex likelihood ratios

abstract: This work includes a new characterization of the multivariate normal distribution. In particular, it is shown that a positive density function $f$ is Gaussian if and only if the $f(x+ y)/f(x)$ is convex in $x$ for every $y$. This result has implications to recent research regarding inadmissibility of a test studied by Moran~(1973).


title: On the Dynamics of the Tavis-Cummings Model

abstract: The purpose of this paper is to present a comprehensive study of the Tavis-Cummings model from a system-theoretic perspective. A typical form of the Tavis-Cummings model is composed of an ensemble of non-interacting two-level systems (TLSs) that are collectively coupled to a common cavity resonator. The associated quantum linear passive system is proposed, whose canonical form reveals typical features of the Tavis-Cummings model, including $\sqrt{N}$- scaling, dark states, bright states, single-excitation superradiant and subradiant states. The passivity of this linear system is related to the vacuum Rabi mode splitting phenomenon in Tavis-Cummings systems. On the basis of the linear model, an analytic form is presented for the steady-state output state of the Tavis-Cummings model driven by a single-photon state. Master equations are used to study the excitation properties of the Tavis-Cummings model in the multi-excitation scenario. Finally, in terms of the transition matrix for a linear time-varying system, a computational framework is proposed for calculating the state of the Tavis-Cummings model, which is applicable to the multi-excitation case.


title: Hamilton-Jacobi Equations of Controlled Magnetic Hamiltonian System with Nonholonomic Constraint

abstract: In order to describe the impact of different geometric structures and constraints for the dynamics of a regular controlled Hamiltonian system, in this paper, we first define a kind of controlled magnetic Hamiltonian (CMH) system, and give a good expression of the dynamical vector field of the CMH system, such that we can describe the magnetic vanishing condition and the CMH-equivalence, and derive precisely the geometric constraint conditions of the magnetic symplectic form for the dynamical vector field of the CMH system, which are called the Type I and Type II of Hamilton-Jacobi equation. Secondly, we prove that the CMH-equivalence for the CMH systems leaves the solutions of corresponding to Hamilton-Jacobi equations invariant, if the associated magnetic Hamiltonian systems are equivalent. Thirdly, we consider the CMH system with nonholonomic constraint, and derive a distributional CMH system, which is determined by a non-degenerate distributional two-form induced from the magnetic symplectic form. Then we drive precisely two types of Hamilton-Jacobi equation for the distributional CMH system. Moreover, we generalize the above results for the nonholonomic reducible CMH system with symmetry, and prove two types of Hamilton-Jacobi theorems for the nonholonomic reduced distributional CMH system. These research works reveal the deeply internal relationships of the magnetic symplectic forms, the nonholonomic constraints, the dynamical vector fields and controls of the CMH systems.


title: Extended Double Covers and Homomorphism Bounds of Signed Graphs

abstract: A \emph{signed graph} $(G, \sigma)$ is a graph $G$ together with an assignment $\sigma:E(G) \rightarrow \{+,-\}$. The notion of homomorphisms of signed graphs is a relatively new development which allows to strengthen the connection between the theories of minors and colorings of graphs. Following this thread of thoughts, we investigate this connection through the notion of Extended Double Covers of signed graphs, which was recently introduced by Naserasr, Sopena and Zaslavsky. More precisely, we say that a signed graph $(B, \pi)$ is planar-complete if any planar signed graph $(G, \sigma)$ which verifies the conditions of a basic no-homomorphism lemma with respect to $(B,\pi)$ admits a homomorphism to $(B, \pi)$. Our conjecture then is that: if $(B, \pi)$ is a connected signed graph with no positive odd closed walk which is planar-complete, then its Extended Double Cover ${\rm EDC}(B,\pi)$ is also planar-complete. We observe that this conjecture largely extends the Four-Color Theorem and is strongly connected to a number of conjectures in extension of this famous theorem. A given (signed) graph $(B,\pi)$ \emph{bounds} a class of (signed) graphs if every (signed) graph in the class admits a homomorphism to $(B,\pi)$. In this work, and in support of our conjecture, we prove it for the subclass of signed $K_4$-minor free graphs. Inspired by this development, we then investigate the problem of finding optimal homomorphism bounds for subclasses of signed $K_4$-minor-free graphs with restrictions on their girth and we present nearly optimal solutions. Our work furthermore leads to the development of weighted signed graphs.


title: Federated Linear Contextual Bandits

abstract: This paper presents a novel federated linear contextual bandits model, where individual clients face different $K$-armed stochastic bandits coupled through common global parameters. By leveraging the geometric structure of the linear rewards, a collaborative algorithm called Fed-PE is proposed to cope with the heterogeneity across clients without exchanging local feature vectors or raw data. Fed-PE relies on a novel multi-client G-optimal design, and achieves near-optimal regrets for both disjoint and shared parameter cases with logarithmic communication costs. In addition, a new concept called collinearly-dependent policies is introduced, based on which a tight minimax regret lower bound for the disjoint parameter case is derived. Experiments demonstrate the effectiveness of the proposed algorithms on both synthetic and real-world datasets.


title: Extreme values of the Dirichlet $L$-functions at the critical points of the Riemann zeta function

abstract: We estimate large and small values of $|L(\rho',\chi)|$, where $\chi$ is a primitive character mod $q$ for $q>2$ and $\rho'$ runs over critical points of the Riemann zeta function in the right half of the one-line, that is, the points where $\zeta'(\rho')=0$ and $1\leq\Re \rho'$. It would be interesting to study how a certain Dirichlet $L$-function behaves at the critical points of the Riemann zeta function. We expect extreme values that an $L$-function would take at the critical points of the Riemann zeta function to be very close to the extreme values that the $L$-function would otherwise take to the right of the vertical line $\Re s=1 $. That is, an $L$-function is expected to behave in a manner that is independent of the nature of the points that are special with respect to the Riemann zeta function. The results obtained in this paper corroborate this behavior.


title: Solar Coronal Magnetic Fields and Sensitivity Requirements for Spectropolarimetry Channel of VELC Onboard Aditya-L1

abstract: Understanding solar coronal magnetic fields is crucial to address the long-standing mysteries of the solar corona and solar wind. Although routine photospheric magnetic fields (MFs) are available for decades, coronal MFs are rarely reported. Visible Emission Line Coronagraph (VELC) on board Aditya-L1 mission (planned to launch in the near future) can directly measure the MFs in the inner solar corona. This can be achieved with the help of spectropolarimetric observations of the forbidden coronal emission line centered at 1074.7 nm over a field of view 1.05 R$_{\odot}$ - 1.5 R$_{\odot}$. In this article, we summarize various direct and indirect techniques used to estimate the MFs at different wavelength regimes. Further, we summarize the expected accuracies that are required to estimate MFs using VELC's spectropolarimetry channel.


title: AeCoM: An Aerial Continuum Manipulator with Precise Kinematic Modeling for Variable Loading and Tendon-slacking Prevention

abstract: Aerial robotic systems have raised emerging interests in recent years. In this article, we propose a novel aerial manipulator system that is significantly different from conventional aerial discrete manipulators: An Aerial Continuum Manipulator (AeCoM). The AeCoM compactly integrates a quadrotor with a tendon-driven continuum robotic manipulator. Due to the compact design and the payload bearing ability of tendon-driven continuum robotic arms, the proposed system solved the conflict between payload capacity and dexterity lying in conventional aerial manipulators. Two contributions are made in this paper: 1) a sensor-based kinematic model is developed for precise modeling in the presence of variable loading; and 2) a tendon slacking prevention system is developed in the presence of aggressive motions. The detailed design of the system is presented and extensive experimental validations have been performed to validate the system self-initialization, payload capacity, precise kinematic modeling with variable end-effector (EE) loadings during aerial grasping and tendon-slacking prevention. The experimental results demonstrate that the proposed novel aerial continuum manipulator system solves the constraints in conventional aerial manipulators and has more potential applications in clustered environments.


title: QU-net++: Image Quality Detection Framework for Segmentation of Medical 3D Image Stacks

abstract: Automated segmentation of pathological regions of interest aids medical image diagnostics and follow-up care. However, accurate pathological segmentations require high quality of annotated data that can be both cost and time intensive to generate. In this work, we propose an automated two-step method that detects a minimal image subset required to train segmentation models by evaluating the quality of medical images from 3D image stacks using a U-net++ model. These images that represent a lack of quality training can then be annotated and used to fully train a U-net-based segmentation model. The proposed QU-net++ model detects this lack of quality training based on the disagreement in segmentations produced from the final two output layers. The proposed model isolates around 10% of the slices per 3D image stack and can scale across imaging modalities to segment cysts in OCT images and ground glass opacity (GGO) in lung CT images with Dice scores in the range 0.56-0.72. Thus, the proposed method can be applied for cost effective multi-modal pathology segmentation tasks.


title: Evidential Softmax for Sparse Multimodal Distributions in Deep Generative Models

abstract: Many applications of generative models rely on the marginalization of their high-dimensional output probability distributions. Normalization functions that yield sparse probability distributions can make exact marginalization more computationally tractable. However, sparse normalization functions usually require alternative loss functions for training since the log-likelihood is undefined for sparse probability distributions. Furthermore, many sparse normalization functions often collapse the multimodality of distributions. In this work, we present $\textit{ev-softmax}$, a sparse normalization function that preserves the multimodality of probability distributions. We derive its properties, including its gradient in closed-form, and introduce a continuous family of approximations to $\textit{ev-softmax}$ that have full support and can be trained with probabilistic loss functions such as negative log-likelihood and Kullback-Leibler divergence. We evaluate our method on a variety of generative models, including variational autoencoders and auto-regressive architectures. Our method outperforms existing dense and sparse normalization techniques in distributional accuracy. We demonstrate that $\textit{ev-softmax}$ successfully reduces the dimensionality of probability distributions while maintaining multimodality.


title: (Im)balance in the Representation of News? An Extensive Study on a Decade Long Dataset from India

abstract: (Im)balance in the representation of news has always been a topic of debate in political circles. The concept of balance has often been discussed and studied in the context of the social responsibility theory and the prestige press in the USA. While various qualitative, as well as quantitative measures of balance, have been suggested in the literature, a comprehensive analysis of all these measures across a large dataset of the post-truth era comprising different popular news media houses and over a sufficiently long temporal scale in a non-US democratic setting is lacking. We use this concept of balance to measure and understand the evolution of imbalance in Indian media on various journalistic metrics on a month-by-month basis. For this study, we amass a huge dataset of over four million political articles from India for 9+ years and analyze the extent and quality of coverage given to issues and political parties in the context of contemporary influential events for three leading newspapers. We use several state-of-the-art NLP tools to effectively understand political polarization (if any) manifesting in these articles over time. We find that two out of the three news outlets are more strongly clustered in their imbalance metrics. We also observe that only a few locations are extensively covered across all the news outlets and the situation is only slightly getting better for one of the three news outlets. Cloze tests show that the changing landscape of events get reflected in all the news outlets with border and terrorism issues dominating in around 2010 while economic aspects like unemployment, GST, demonetization, etc. became more dominant in the period 2014 -- 2018. Further, cloze tests clearly portray the changing popularity profile of the political parties over time.


title: OpeNPDN: A Neural-network-based Framework for Power Delivery Network Synthesis

abstract: Power delivery network (PDN) design is a nontrivial, time-intensive, and iterative task. Correct PDN design must account for considerations related to power bumps, currents, blockages, and signal congestion distribution patterns. This work proposes a machine learning-based methodology that employs a set of predefined PDN templates. At the floorplan stage, coarse estimates of current, congestion, macro/blockages, and C4 bump distributions are used to synthesize a grid for early design. At the placement stage, the grid is incrementally refined based on more accurate and fine-grained distributions of current and congestion. At each stage, a convolutional neural network (CNN) selects an appropriate PDN template for each region on the chip, building a safe-by-construction PDN that meets IR drop and electromigration (EM) specifications. The CNN is initially trained using a large synthetically-created dataset, following which transfer learning is leveraged to bridge the gap between real-circuit data (with a limited dataset size) and synthetically-generated data. On average, the optimization of the PDN frees thousands of routing tracks in congestion-critical regions, when compared to a globally uniform PDN, while staying within the IR drop and EM limits.


title: Massive MIMO NOMA with Wavelet Pulse Shaping to Minimize Undesired Channel Interference

abstract: In this article, wavelet OFDM based non-orthogonal-multiple-access (NOMA) combined with massive MIMO system for 6G networks is proposed. For mMIMO transmissions, the proposed system could enhance the performance by utilizing wavelets to compensate for channel impairments on the transmitted signal. Performance measures include spectral efficiency, symbol error rate (SER), and peak to average ratio (PAPR). Simulation results prove that the proposed system outperforms the conventional OFDM based NOMA systems.


title: High performance distributed feedback quantum dot lasers with laterally coupled dielectric grating

abstract: The combination of grating-based frequency-selective optical feedback mechanisms, such as distributed feedback (DFB) or distributed Bragg reflector (DBR) structures, with quantum dot (QD) gain materials is a main approach towards ultra-high-performance semiconductor lasers for many key novel applications, either as stand-alone sources or as on-chip sources in photonic integrated circuits. However, the fabrication of conventional buried Bragg grating structures on GaAs, GaAs/Si, GaSb and other material platforms have been met with major material regrowth difficulties. We report a novel and universal approach of introducing laterally coupled dielectric Bragg gratings to semiconductor lasers that allows highly controllable, reliable and strong coupling between the grating and the optical mode. We implement such a grating structure in a low-loss amorphous silicon material alongside GaAs lasers with InAs/GaAs QD gain layers. The resulting DFB laser arrays emit at pre-designed 0.8 THz LWDM frequency intervals in the 1300 nm band with record performance parameters, including side mode suppression ratios as high as 52.7 dB, continuous-wave output power of 27.7 mW (room-temperature) and 10 mW (at 70{\deg}C), and ultra-low relative intensity noise (RIN) of < -165 dB/Hz (2.5-25 GHz). The devices are also capable of operating isolator-free under very high external reflection levels of up to -12.3 dB whilst maintaining the high spectral and ultra-low RIN qualities. These results validate the novel laterally coupled dielectric grating as a technologically superior and potentially cost-effective approach for fabricating DFB and DBR lasers free of their semiconductor material constraints, thus universally applicable across different material platforms and wavelength bands.


title: An Experimental Study of Permanently Stored Learned Clauses

abstract: Modern CDCL SAT solvers learn clauses rapidly, and an important heuristic is the clause deletion scheme. Most current solvers have two (or more) stores of clauses. One has ``valuable'' clauses which are never deleted. Most learned clauses are added to the other, with an aggressive deletion strategy to restrict its size. Recent solvers in the MapleSAT family, have comparatively complex deletion scheme, and perform well. Many solvers store only binary clauses permanently, but MapleLCMDistChronoBT stores clauses with small LBD permanently. We report an experimental study of the permanent clause store in MapleLCMDistChronoBT. We observe that this store can get quite large, but several methods for limiting its size reduced performance. We also show that alternate size and LBD based criteria improve performance, while still having large permanent stores. In particular, saving clauses up to size 8, and adding small numbers of high-centrality clauses, both improved performance, with the best improvement using both methods.


title: RoMA: Robust Model Adaptation for Offline Model-based Optimization

abstract: We consider the problem of searching an input maximizing a black-box objective function given a static dataset of input-output queries. A popular approach to solving this problem is maintaining a proxy model, e.g., a deep neural network (DNN), that approximates the true objective function. Here, the main challenge is how to avoid adversarially optimized inputs during the search, i.e., the inputs where the DNN highly overestimates the true objective function. To handle the issue, we propose a new framework, coined robust model adaptation (RoMA), based on gradient-based optimization of inputs over the DNN. Specifically, it consists of two steps: (a) a pre-training strategy to robustly train the proxy model and (b) a novel adaptation procedure of the proxy model to have robust estimates for a specific set of candidate solutions. At a high level, our scheme utilizes the local smoothness prior to overcome the brittleness of the DNN. Experiments under various tasks show the effectiveness of RoMA compared with previous methods, obtaining state-of-the-art results, e.g., RoMA outperforms all at 4 out of 6 tasks and achieves runner-up results at the remaining tasks.


title: Robust Contrastive Learning Using Negative Samples with Diminished Semantics

abstract: Unsupervised learning has recently made exceptional progress because of the development of more effective contrastive learning methods. However, CNNs are prone to depend on low-level features that humans deem non-semantic. This dependency has been conjectured to induce a lack of robustness to image perturbations or domain shift. In this paper, we show that by generating carefully designed negative samples, contrastive learning can learn more robust representations with less dependence on such features. Contrastive learning utilizes positive pairs that preserve semantic information while perturbing superficial features in the training images. Similarly, we propose to generate negative samples in a reversed way, where only the superfluous instead of the semantic features are preserved. We develop two methods, texture-based and patch-based augmentations, to generate negative samples. These samples achieve better generalization, especially under out-of-domain settings. We also analyze our method and the generated texture-based samples, showing that texture features are indispensable in classifying particular ImageNet classes and especially finer classes. We also show that model bias favors texture and shape features differently under different test settings. Our code, trained models, and ImageNet-Texture dataset can be found at https://github.com/SongweiGe/Contrastive-Learning-with-Non-Semantic-Negatives.


title: Light-modulated Josephson effect in Kekul\'e patterned graphene

abstract: We theoretically study the Josephson effect in a superconductor/normal metal/superconductor junction based on Kekul\'e patterned graphene. For the Kekul\'e-O patterned junctions, a Fermi momentum-splitting Andreev reflection at the interface can be induced by the off-resonant circularly polarized light applied in the normal region, which results in the possible $\pi$-state. In contrast, for the Kekul\'e-Y patterned junctions, the Fermi momentum-splitting Andreev reflection is strongly suppressed due to the valley-momentum locking and the junction always exhibits the 0-state. The dependence of the critical current on the junction length and the illumination parameter of the light field is also presented in detail.


title: Mixed Supervised Object Detection by Transferring Mask Prior and Semantic Similarity

abstract: Object detection has achieved promising success, but requires large-scale fully-annotated data, which is time-consuming and labor-extensive. Therefore, we consider object detection with mixed supervision, which learns novel object categories using weak annotations with the help of full annotations of existing base object categories. Previous works using mixed supervision mainly learn the class-agnostic objectness from fully-annotated categories, which can be transferred to upgrade the weak annotations to pseudo full annotations for novel categories. In this paper, we further transfer mask prior and semantic similarity to bridge the gap between novel categories and base categories. Specifically, the ability of using mask prior to help detect objects is learned from base categories and transferred to novel categories. Moreover, the semantic similarity between objects learned from base categories is transferred to denoise the pseudo full annotations for novel categories. Experimental results on three benchmark datasets demonstrate the effectiveness of our method over existing methods. Codes are available at https://github.com/bcmi/TraMaS-Weak-Shot-Object-Detection.


title: On continuity of accessible functors

abstract: We prove that for each locally $\alpha$-presentable category $\mathcal K$ there exists a regular cardinal $\gamma$ such that any $\alpha$-accessible functor out of $\mathcal K$ (into another locally $\alpha$-presentable category) is continuous if and only if it preserves $\gamma$-small limits; as a consequence we obtain a new adjoint functor theorem specific to the $\alpha$-accessible functors out of $\mathcal K$. Afterwards we generalize these results to the enriched setting and deduce, among other things, that a small $\mathcal V$-category is accessible if and only if it is Cauchy complete.


title: Smooth head tracking for virtual reality applications

abstract: In this work, we propose a new head-tracking solution for human-machine real-time interaction with virtual 3D environments. This solution leverages RGBD data to compute virtual camera pose according to the movements of the user's head. The process starts with the extraction of a set of facial features from the images delivered by the sensor. Such features are matched against their respective counterparts in a reference image for the computation of the current head pose. Afterwards, a prediction approach is used to guess the most likely next head move (final pose). Pythagorean Hodograph interpolation is then adapted to determine the path and local frames taken between the two poses. The result is a smooth head trajectory that serves as an input to set the camera in virtual scenes according to the user's gaze. The resulting motion model has the advantage of being: continuous in time, it adapts to any frame rate of rendering; it is ergonomic, as it frees the user from wearing tracking markers; it is smooth and free from rendering jerks; and it is also torsion and curvature minimizing as it produces a path with minimum bending energy.


title: On the inclusion ideal graph of semigroups

abstract: The inclusion ideal graph $\mathcal{I}n(S)$ of a semigroup $S$ is an undirected simple graph whose vertices are all nontrivial left ideals of $S$ and two distinct left ideals $I, J$ are adjacent if and only if either $I \subset J$ or $J \subset I$. The purpose of this paper is to study algebraic properties of the semigroup $S$ as well as graph theoretic properties of $\mathcal{I}n(S)$. In this paper, we investigate the connectedness of $\mathcal{I}n(S)$. We show that diameter of $\mathcal{I}n(S)$ is at most $3$ if it is connected. We also obtain a necessary and sufficient condition of $S$ such that the clique number of $\mathcal{I}n(S)$ is $n$, where $n$ is the number of minimal left ideals of $S$. Further, various graph invariants of $\mathcal{I}n(S)$ viz. perfectness, planarity, girth etc. are discussed. For a completely simple semigroup $S$, we investigate various properties of $\mathcal{I}n(S)$ including its independence number and matching number. Finally, we obtain the automorphism group of $\mathcal{I}n(S)$.


title: Dual-Mode Synchronization Predictive Control of Robotic Manipulator

abstract: To reduce the contour error of the end-effector of a robotic manipulator during trajectory tracking, a dual-mode synchronization predictive control is proposed. Firstly, the dynamic model of n-DoF robotic manipulator is discretized by using the Taylor expansion method, and the mapping relationship between the joint error in the joint space and the contour error in task space is constructed. Secondly, the synchronization error and the tracking error in the joint space are defined, and the coupling error of joints is derived through the coupling coefficient . Thirdly, a dual-mode synchronization predictive control is proposed, and the stability of the proposed control system is guaranteed using constraint set conditions. Finally, numerical simulation and experimental results are shown to prove the effectiveness of the proposed control strategy.


title: From Image to Imuge: Immunized Image Generation

abstract: We introduce Imuge, an image tamper resilient generative scheme for image self-recovery. The traditional manner of concealing image content within the image are inflexible and fragile to diverse digital attack, i.e. image cropping and JPEG compression. To address this issue, we jointly train a U-Net backboned encoder, a tamper localization network and a decoder for image recovery. Given an original image, the encoder produces a visually indistinguishable immunized image. At the recipient's side, the verifying network localizes the malicious modifications, and the original content can be approximately recovered by the decoder, despite the presence of the attacks. Several strategies are proposed to boost the training efficiency. We demonstrate that our method can recover the details of the tampered regions with a high quality despite the presence of various kinds of attacks. Comprehensive ablation studies are conducted to validate our network designs.


title: Encoder-Decoder Networks for Analyzing Thermal and Power Delivery Networks

abstract: Power delivery network (PDN) analysis and thermal analysis are computationally expensive tasks that are essential for successful IC design. Algorithmically, both these analyses have similar computational structure and complexity as they involve the solution to a partial differential equation of the same form. This paper converts these analyses into image-to-image and sequence-to-sequence translation tasks, which allows leveraging a class of machine learning models with an encoder-decoder-based generative (EDGe) architecture to address the time-intensive nature of these tasks. For PDN analysis, we propose two networks: (i) IREDGe: a full-chip static and dynamic IR drop predictor and (ii) EMEDGe: electromigration (EM) hotspot classifier based on input power, power grid distribution, and power pad distribution patterns. For thermal analysis, we propose ThermEDGe, a full-chip static and dynamic temperature estimator based on input power distribution patterns for thermal analysis. These networks are transferable across designs synthesized within the same technology and packing solution. The networks predict on-chip IR drop, EM hotspot locations, and temperature in milliseconds with negligibly small errors against commercial tools requiring several hours.


title: A Shiny Application for Conducting Electronic Surveys Using Randomized Response Techniques

abstract: Randomized response techniques (RRT) are useful for collecting information on sensitive or confidential attributes in sample surveys. However, such RRTs are rarely used except for pure academic research, as they are deemed to be confusing for respondents and difficult to be administered. Switching to an electronic medium is a solution for this. Standard electronic survey mediums lack the option of effectively incorporating a randomization device into it. This paper introduces a Shiny application that implements two popular Randomized Response Techniques, namely, Warner (1965) and Simmons (1967), to collect information on sensitive issues via electronic surveys, and save them using local or remote storage. Code and its detailed explanation has been provided for suitable use by survey statisticians and practitioners. The method suggested here can be extended to implement any Randomized Response Technique. Thus, this paper lays the groundwork of implementing RRTs as electronic surveys for widespread use by the polling industry.


title: Arbitrarily Fast Switched Distributed Stabilization of Partially Unknown Interconnected Multiagent Systems: A Proactive Cyber Defense Perspective

abstract: A design framework recently has been developed to stabilize interconnected multiagent systems in a distributed manner, and systematically capture the architectural aspect of cyber-physical systems. Such a control theoretic framework, however, results in a stabilization protocol which is passive with respect to the cyber attacks and conservative regarding the guaranteed level of resiliency. We treat the control layer topology and stabilization gains as the degrees of freedom, and develop a mixed control and cybersecurity design framework to address the above concerns. From a control perspective, despite the agent layer modeling uncertainties and perturbations, we propose a new step-by-step procedure to design a set of control sublayers for an arbitrarily fast switching of the control layer topology. From a proactive cyber defense perspective, we propose a satisfiability modulo theory formulation to obtain a set of control sublayer structures with security considerations, and offer a frequent and fast mutation of these sublayers such that the control layer topology will remain unpredictable for the adversaries. We prove the robust input-to-state stability of the two-layer interconnected multiagent system, and validate the proposed ideas in simulation.


title: Denoised Non-Local Neural Network for Semantic Segmentation

abstract: The non-local network has become a widely used technique for semantic segmentation, which computes an attention map to measure the relationships of each pixel pair. However, most of the current popular non-local models tend to ignore the phenomenon that the calculated attention map appears to be very noisy, containing inter-class and intra-class inconsistencies, which lowers the accuracy and reliability of the non-local methods. In this paper, we figuratively denote these inconsistencies as attention noises and explore the solutions to denoise them. Specifically, we inventively propose a Denoised Non-Local Network (Denoised NL), which consists of two primary modules, i.e., the Global Rectifying (GR) block and the Local Retention (LR) block, to eliminate the inter-class and intra-class noises respectively. First, GR adopts the class-level predictions to capture a binary map to distinguish whether the selected two pixels belong to the same category. Second, LR captures the ignored local dependencies and further uses them to rectify the unwanted hollows in the attention map. The experimental results on two challenging semantic segmentation datasets demonstrate the superior performance of our model. Without any external training data, our proposed Denoised NL can achieve the state-of-the-art performance of 83.5\% and 46.69\% mIoU on Cityscapes and ADE20K, respectively.


title: The generalized holographic $c$-function for regular AdS black holes

abstract: We use the causal horizon entropy to study the asymptotic behaviors of regular AdS black holes. In some literature, the causal horizon entropy is regarded as a generalized holographic $c$-function. In this paper, we apply this idea to the case of regular AdS black holes. We show that the causal horizon entropy decreases to zero at the center of regular AdS black holes and in particular it is stationary because its derivative with respect to the affine parameter approaches zero asymptotically. Meanwhile, the asymptotic behavior of the metric of regular AdS black holes implies that the black hole center corresponds to an IR fixed point. Therefore, we conclude that the causal horizon entropy is a valid candidate for the holographic $c$-function of these regular AdS black holes.


title: Revisit Multimodal Meta-Learning through the Lens of Multi-Task Learning

abstract: Multimodal meta-learning is a recent problem that extends conventional few-shot meta-learning by generalizing its setup to diverse multimodal task distributions. This setup makes a step towards mimicking how humans make use of a diverse set of prior skills to learn new skills. Previous work has achieved encouraging performance. In particular, in spite of the diversity of the multimodal tasks, previous work claims that a single meta-learner trained on a multimodal distribution can sometimes outperform multiple specialized meta-learners trained on individual unimodal distributions. The improvement is attributed to knowledge transfer between different modes of task distributions. However, there is no deep investigation to verify and understand the knowledge transfer between multimodal tasks. Our work makes two contributions to multimodal meta-learning. First, we propose a method to quantify knowledge transfer between tasks of different modes at a micro-level. Our quantitative, task-level analysis is inspired by the recent transference idea from multi-task learning. Second, inspired by hard parameter sharing in multi-task learning and a new interpretation of related work, we propose a new multimodal meta-learner that outperforms existing work by considerable margins. While the major focus is on multimodal meta-learning, our work also attempts to shed light on task interaction in conventional meta-learning. The code for this project is available at https://miladabd.github.io/KML.


title: Syllabic Quantity Patterns as Rhythmic Features for Latin Authorship Attribution

abstract: It is well known that, within the Latin production of written text, peculiar metric schemes were followed not only in poetic compositions, but also in many prose works. Such metric patterns were based on so-called syllabic quantity, i.e., on the length of the involved syllables, and there is substantial evidence suggesting that certain authors had a preference for certain metric patterns over others. In this research we investigate the possibility to employ syllabic quantity as a base for deriving rhythmic features for the task of computational authorship attribution of Latin prose texts. We test the impact of these features on the authorship attribution task when combined with other topic-agnostic features. Our experiments, carried out on three different datasets, using two different machine learning methods, show that rhythmic features based on syllabic quantity are beneficial in discriminating among Latin prose authors.


title: The continuous dependence and non-uniform dependence of the rotation Camassa-Holm equation in Besov spaces

abstract: In this paper, we first establish the local well-posedness and continuous dependence for the rotation Camassa-Holm equation modelling the equatorial water waves with the weak Coriolis effect in nonhomogeneous Besov spaces $B^s_{p,r}$ with $s>1+1/p$ or $s=1+1/p,\ p\in[1,+\infty),\ r=1$ by a new way: the compactness argument and Lagrangian coordinate transformation, which removes the index constraint $s>3/2$ and improves our previous work \cite{guoy1}. Then, we prove the solution is not uniformly continuous dependence on the initial data in both supercritical and critical Besov spaces.


title: FedPrune: Towards Inclusive Federated Learning

abstract: Federated learning (FL) is a distributed learning technique that trains a shared model over distributed data in a privacy-preserving manner. Unfortunately, FL's performance degrades when there is (i) variability in client characteristics in terms of computational and memory resources (system heterogeneity) and (ii) non-IID data distribution across clients (statistical heterogeneity). For example, slow clients get dropped in FL schemes, such as Federated Averaging (FedAvg), which not only limits overall learning but also biases results towards fast clients. We propose FedPrune; a system that tackles this challenge by pruning the global model for slow clients based on their device characteristics. By doing so, slow clients can train a small model quickly and participate in FL which increases test accuracy as well as fairness. By using insights from Central Limit Theorem, FedPrune incorporates a new aggregation technique that achieves robust performance over non-IID data. Experimental evaluation shows that Fed- Prune provides robust convergence and better fairness compared to Federated Averaging.


title: The Quantum Approximate Optimization Algorithm at High Depth for MaxCut on Large-Girth Regular Graphs and the Sherrington-Kirkpatrick Model

abstract: The Quantum Approximate Optimization Algorithm (QAOA) finds approximate solutions to combinatorial optimization problems. Its performance monotonically improves with its depth $p$. We apply the QAOA to MaxCut on large-girth $D$-regular graphs. We give an iterative formula to evaluate performance for any $D$ at any depth $p$. Looking at random $D$-regular graphs, at optimal parameters and as $D$ goes to infinity, we find that the $p=11$ QAOA beats all classical algorithms (known to the authors) that are free of unproven conjectures. While the iterative formula for these $D$-regular graphs is derived by looking at a single tree subgraph, we prove that it also gives the ensemble-averaged performance of the QAOA on the Sherrington-Kirkpatrick (SK) model defined on the complete graph. We also generalize our formula to Max-$q$-XORSAT on large-girth regular hypergraphs. Our iteration is a compact procedure, but its computational complexity grows as $O(p^2 4^p)$. This iteration is more efficient than the previous procedure for analyzing QAOA performance on the SK model, and we are able to numerically go to $p=20$. Encouraged by our findings, we make the optimistic conjecture that the QAOA, as $p$ goes to infinity, will achieve the Parisi value. We analyze the performance of the quantum algorithm, but one needs to run it on a quantum computer to produce a string with the guaranteed performance.


title: How Much Coffee Was Consumed During EMNLP 2019? Fermi Problems: A New Reasoning Challenge for AI

abstract: Many real-world problems require the combined application of multiple reasoning abilities employing suitable abstractions, commonsense knowledge, and creative synthesis of problem-solving strategies. To help advance AI systems towards such capabilities, we propose a new reasoning challenge, namely Fermi Problems (FPs), which are questions whose answers can only be approximately estimated because their precise computation is either impractical or impossible. For example, "How much would the sea level rise if all ice in the world melted?" FPs are commonly used in quizzes and interviews to bring out and evaluate the creative reasoning abilities of humans. To do the same for AI systems, we present two datasets: 1) A collection of 1k real-world FPs sourced from quizzes and olympiads; and 2) a bank of 10k synthetic FPs of intermediate complexity to serve as a sandbox for the harder real-world challenge. In addition to question answer pairs, the datasets contain detailed solutions in the form of an executable program and supporting facts, helping in supervision and evaluation of intermediate steps. We demonstrate that even extensively fine-tuned large scale language models perform poorly on these datasets, on average making estimates that are off by two orders of magnitude. Our contribution is thus the crystallization of several unsolved AI problems into a single, new challenge that we hope will spur further advances in building systems that can reason.


title: Remarks on the global well-posedness of the axisymmetric Boussinesq system with rough initial data

abstract: This work concerns the global well-posedness problem for the 3D axisymmetric viscous Boussinesq system with critical rough initial data. More precisely, we aim to extending our recent result \cite{Hanachi-Houamed-Zerguine} to the case of initial data of measure type. To this end, we should first develop some notions of axisymmetric measures in a general context, then, in the spirit of \cite{Gallay-Sverak}, we prove the global wellposedness result provided that the atomic parts of the initial measures are small enough.


title: Fast Distributed Stochastic Scheduling for A Multi-Energy Industrial Park

abstract: The multi-energy management framework of industrial parks advocates energy conversion and scheduling, which takes full advantage of the compensation and temporal availability of multiple energy. However, how to exploit elastic loads and compensate inelastic loads to match multiple generators and storage is still a key problem under the uncertainty of demand and supply. To solve the issue, the energy management problem is constructed as a stochastic optimization problem. The optimization aims are to minimize the time-averaged energy cost and improve the energy efficiency while respecting the energy constraints. To achieve the distributed implementation in real time without knowing any priori knowledge of underlying stochastic process, a distributed stochastic gradient algorithm based on dual decomposition and a fast scheme are proposed. The numerical results based on real data show that the industrial park, by adopting the proposed algorithm, can achieve social welfare maximization asymptotically.


title: Which Part of Dense Cores Feeds Material to Protostars?: The Case of L1489 IRS

abstract: We have conducted mapping observations ($\sim 2'\times2'$) of the Class I protostar L1489 IRS using the 7-m array of the Atacama Compact Array (ACA) and the IRAM-30m telescope in the $\mathrm{C^{18}O}$ 2-1 emission to investigate the gas kinematics on 1000-10,000 au scales. The $\mathrm{C^{18}O}$ emission shows a velocity gradient across the protostar in a direction almost perpendicular to the outflow. The radial profile of the peak velocity was measured from a $\mathrm{C^{18}O}$ position-velocity diagram cut along the disk major axis. The measured peak velocity decreases with radius at a radii of $\sim$1400-2900 au, but increases slightly or is almost constant at radii of $r\gtrsim$2900 au. Disk-and-envelope models were compared with the observations to understand the nature of the radial profile of the peak velocity. The measured peak velocities are best explained by a model where the specific angular momentum is constant within a radius of 2900 au but increases with radius outside 2900 au. We calculated the radial profile of the specific angular momentum from the measured peak velocities, and compared it to analytic models of core collapse. The analytic models reproduce well the observed radial profile of the specific angular momentum and suggest that material within a radius of $\sim$4000-6000 au in the initial dense core has accreted to the central protostar. Because dense cores are typically $\sim$10,000-20,000 au in radius, and as L1489 IRS is close to the end of mass accretion phase, our result suggests that only a fraction of a dense core eventually forms a star.


title: Beamforming Feedback-based Model-Driven Angle of Departure Estimation Toward Legacy Support in WiFi Sensing: An Experimental Study

abstract: This study experimentally validated the possibility of angle of departure (AoD) estimation using multiple signal classification (MUSIC) with only WiFi control frames for beamforming feedback (BFF), defined in IEEE 802.11ac/ax. The examined BFF-based MUSIC is a model-driven algorithm, which does not require a pre-obtained database. This contrasts with most existing BFF-based sensing techniques, which are data-driven and require a pre-obtained database. Moreover, the BFF-based MUSIC affords an alternative AoD estimation method without access to channel state information (CSI). Specifically, the extensive experimental and numerical evaluations demonstrated that the BFF-based MUSIC successfully estimates the AoDs for multiple propagation paths. Moreover, the evaluations performed in this study revealed that the BFF-based MUSIC achieved a comparable error of AoD estimation to the CSI-based MUSIC, while BFF is a highly compressed version of CSI in IEEE 802.11ac/ax.


title: Thermoplasmonic Nanomagnetic Logic Gates

abstract: Nanomagnetic logic, in which the outcome of a computation is embedded into the energy hierarchy of magnetostatically coupled nanomagnets, offers an attractive pathway to implement in-memory computation. This computational paradigm avoids separate energy costs associated with transporting and storing the outcome of a computational operation. Thermally-driven nanomagnetic logic gates, which are driven solely by the ambient thermal energy, hold great promise for energy-efficient operation, but have the disadvantage of slow operating speeds due to the lack of spatial selectivity of currently-employed global heating methods. As has been shown recently, this disadvantage can be removed by employing local plasmon-assisted photo-heating. Here, we show by means of micromagnetic and finite-elements simulations how such local heating can be exploited to design reconfigurable nanomagnetic Boolean logic gates. The reconfigurability of operation is achieved either by modifying the initialising field protocol or optically, by changing the order in which horizontally and vertically polarised laser pulses are applied. Our results thus demonstrate that nanomagnetic logic offers itself as a fast (up to GHz), energy-efficient and reconfigurable platform for in-memory computation that can be controlled via optical means.


title: Neural View Synthesis and Matching for Semi-Supervised Few-Shot Learning of 3D Pose

abstract: We study the problem of learning to estimate the 3D object pose from a few labelled examples and a collection of unlabelled data. Our main contribution is a learning framework, neural view synthesis and matching, that can transfer the 3D pose annotation from the labelled to unlabelled images reliably, despite unseen 3D views and nuisance variations such as the object shape, texture, illumination or scene context. In our approach, objects are represented as 3D cuboid meshes composed of feature vectors at each mesh vertex. The model is initialized from a few labelled images and is subsequently used to synthesize feature representations of unseen 3D views. The synthesized views are matched with the feature representations of unlabelled images to generate pseudo-labels of the 3D pose. The pseudo-labelled data is, in turn, used to train the feature extractor such that the features at each mesh vertex are more invariant across varying 3D views of the object. Our model is trained in an EM-type manner alternating between increasing the 3D pose invariance of the feature extractor and annotating unlabelled data through neural view synthesis and matching. We demonstrate the effectiveness of the proposed semi-supervised learning framework for 3D pose estimation on the PASCAL3D+ and KITTI datasets. We find that our approach outperforms all baselines by a wide margin, particularly in an extreme few-shot setting where only 7 annotated images are given. Remarkably, we observe that our model also achieves an exceptional robustness in out-of-distribution scenarios that involve partial occlusion.


title: The Rossiter-McLaughlin effect Revolutions: An ultra-short period planet and a warm mini-Neptune on perpendicular orbits

abstract: Comparisons of the alignment of exoplanets with a common host star can be used to distinguish among concurrent evolution scenarios. However, multi-planet systems usually host mini-Neptunes and super-Earths, whose size make orbital architecture measurements challenging. We introduce the Rossiter-McLaughlin effect Revolutions technique, which can access spin-orbit angles of small planets by exploiting the full information contained in spectral transit time series. We validated the technique on published HARPS-N data of the mini-Neptune HD3167c, refining its high sky-projected spin-orbit angle (-108.9+5.4-5.5 deg), and we applied it to new ESPRESSO observations of the super-Earth HD3167b, revealing an aligned orbit (-6.6+6.6-7.9 deg). Surprisingly different variations in the contrast of the stellar lines occulted by the planets can be reconciled with a latitudinal dependence of the stellar line shape. In this scenario, a joint fit to both datasets constrains the inclination of the star (111.6+3.1-3.3 deg) and the 3D spin-orbit angles of HD3167b (29.5+7.2-9.4 deg) and HD3167c (107.7+5.1-4.9 deg). The projected spin-orbit angles do not depend on the model for the line contrast variations, and so, with a mutual inclination of 102.3+7.4-8.0 deg, we conclude that the two planets are on perpendicular orbits. This could be explained by HD3167b being strongly coupled to the star and retaining its primordial alignment, whereas HD3167c would have been brought to a nearly polar orbit via secular gravitational interactions with an outer companion. Follow-up observations and dynamical evolution simulations are required to search for this companion and explore this scenario. HD3167b is the smallest exoplanet with a confirmed spectroscopic Rossiter-McLaughlin signal. Our new technique opens the way to determining the orbital architectures of the super-Earth and Earth-sized planet populations.


title: Beyond Classification: Knowledge Distillation using Multi-Object Impressions

abstract: Knowledge Distillation (KD) utilizes training data as a transfer set to transfer knowledge from a complex network (Teacher) to a smaller network (Student). Several works have recently identified many scenarios where the training data may not be available due to data privacy or sensitivity concerns and have proposed solutions under this restrictive constraint for the classification task. Unlike existing works, we, for the first time, solve a much more challenging problem, i.e., "KD for object detection with zero knowledge about the training data and its statistics". Our proposed approach prepares pseudo-targets and synthesizes corresponding samples (termed as "Multi-Object Impressions"), using only the pretrained Faster RCNN Teacher network. We use this pseudo-dataset as a transfer set to conduct zero-shot KD for object detection. We demonstrate the efficacy of our proposed method through several ablations and extensive experiments on benchmark datasets like KITTI, Pascal and COCO. Our approach with no training samples, achieves a respectable mAP of 64.2% and 55.5% on the student with same and half capacity while performing distillation from a Resnet-18 Teacher of 73.3% mAP on KITTI.


title: What Do We Mean by Generalization in Federated Learning?

abstract: Federated learning data is drawn from a distribution of distributions: clients are drawn from a meta-distribution, and their data are drawn from local data distributions. Thus generalization studies in federated learning should separate performance gaps from unseen client data (out-of-sample gap) from performance gaps from unseen client distributions (participation gap). In this work, we propose a framework for disentangling these performance gaps. Using this framework, we observe and explain differences in behavior across natural and synthetic federated datasets, indicating that dataset synthesis strategy can be important for realistic simulations of generalization in federated learning. We propose a semantic synthesis strategy that enables realistic simulation without naturally-partitioned data. Informed by our findings, we call out community suggestions for future federated learning works.


title: Dex-NeRF: Using a Neural Radiance Field to Grasp Transparent Objects

abstract: The ability to grasp and manipulate transparent objects is a major challenge for robots. Existing depth cameras have difficulty detecting, localizing, and inferring the geometry of such objects. We propose using neural radiance fields (NeRF) to detect, localize, and infer the geometry of transparent objects with sufficient accuracy to find and grasp them securely. We leverage NeRF's view-independent learned density, place lights to increase specular reflections, and perform a transparency-aware depth-rendering that we feed into the Dex-Net grasp planner. We show how additional lights create specular reflections that improve the quality of the depth map, and test a setup for a robot workcell equipped with an array of cameras to perform transparent object manipulation. We also create synthetic and real datasets of transparent objects in real-world settings, including singulated objects, cluttered tables, and the top rack of a dishwasher. In each setting we show that NeRF and Dex-Net are able to reliably compute robust grasps on transparent objects, achieving 90% and 100% grasp success rates in physical experiments on an ABB YuMi, on objects where baseline methods fail.


title: Crossing indices, traits and the principle of indistinguishability

abstract: A (weak chord) index is a function on the crossings of knot diagrams such that: 1) the index of a crossing does not change under Reidemeister moves; 2) crossings which can be paired by a second Reidemeister move have the same index. We show that one can omit the second condition in the case of the universal index. As a consequence, we get the following principle of indistinguishability for classical knots: crossings of the same sign in a classical knot diagram can not be distinguished by any inherent property.


title: Gyrokinetic simulations of electric current generation in ion temperature gradient driven turbulence

abstract: Gyrokinetic simulations in the collisionless limit demonstrate the physical mechanisms and the amplitude of the current driven by turbulence. Simulation results show the spatio-temporal variation of the turbulence driven current and its connection to the divergence of the Reynolds stress and the turbulence acceleration. Fine structures (a few ion Larmor radii) of the turbulence induced current are observed near the rational surfaces with the arbitrary wavelength solver of the quasi-neutrality equation. The divergence of the Reynolds stress plays a major role in the generation of these fine structures. The so-called "spontaneous" current is featured with large local magnitude near the rational surfaces.


title: All conditions for Stein-Weiss inequalities are necessary

abstract: The famous Stein-Weiss inequality on $\mathbf R^n \times \mathbf R^n$, also known as the doubly weighted Hardy-Littlewood-Sobolev inequality, asserts that \[ \Big| \iint_{\mathbf R^n \times \mathbf R^n} \frac{f(x) g(y)}{|x|^\alpha |x-y|^\lambda |y|^\beta} dx dy \Big| \lesssim \| f \| _{L^p(\mathbf R^n)} \| g\| _{L^r(\mathbf R^n)} \] holds for any $f\in L^p(\mathbf R^n)$ and $g\in L^r(\mathbf R^n)$ under several conditions on the parameters $n$, $p$, $r$, $\alpha$, $\beta$, and $\lambda$. Extending the above inequality to either different domains rather than $\mathbf R^n \times \mathbf R^n$ or classes of more general kernels rather than the classical singular kernel $|x-y|^{-\lambda}$ has been the subject of intensive studies over the last three decades. For example, Stein-Weiss inequalities on the upper half space, on the Heisenberg group, on homogeneous Lie group are known. Served as the first step, this work belongs to a set in which the following inequality on the product $\mathbf R^{n-k} \times \mathbf R^n$ is studied \[ \Big| \iint_{\mathbf R^n \times \mathbf R^{n-k}} \frac{f(x) g(y)}{|x|^\alpha |x-y|^\lambda |y|^\beta} dx dy \Big| \lesssim \| f \| _{L^p(\mathbf R^{n-k})} \| g\| _{L^r(\mathbf R^n)}. \] Toward the validity of the above new inequality, in this work, by constructing suitable counter-examples, we establish all conditions for the parameters $n$, $p$, $r$, $\alpha$, $\beta$, and $\lambda$ necessarily for the validity of the above proposed inequality. Surprisingly, these necessary conditions applied to the case $k=1$ suggest that the existing Stein-Weiss inequalities on the upper half space are yet in the optimal range of the parameter $\lambda$. This could reflect limitations of the methods often used. Comments on the Stein-Weiss inequality on homogeneous Lie groups as well as the reverse form for Stein-Weiss inequalities are also made.


title: Learning Diverse Policies in MOBA Games via Macro-Goals

abstract: Recently, many researchers have made successful progress in building the AI systems for MOBA-game-playing with deep reinforcement learning, such as on Dota 2 and Honor of Kings. Even though these AI systems have achieved or even exceeded human-level performance, they still suffer from the lack of policy diversity. In this paper, we propose a novel Macro-Goals Guided framework, called MGG, to learn diverse policies in MOBA games. MGG abstracts strategies as macro-goals from human demonstrations and trains a Meta-Controller to predict these macro-goals. To enhance policy diversity, MGG samples macro-goals from the Meta-Controller prediction and guides the training process towards these goals. Experimental results on the typical MOBA game Honor of Kings demonstrate that MGG can execute diverse policies in different matches and lineups, and also outperform the state-of-the-art methods over 102 heroes.


title: Sample Selection for Fair and Robust Training

abstract: Fairness and robustness are critical elements of Trustworthy AI that need to be addressed together. Fairness is about learning an unbiased model while robustness is about learning from corrupted data, and it is known that addressing only one of them may have an adverse affect on the other. In this work, we propose a sample selection-based algorithm for fair and robust training. To this end, we formulate a combinatorial optimization problem for the unbiased selection of samples in the presence of data corruption. Observing that solving this optimization problem is strongly NP-hard, we propose a greedy algorithm that is efficient and effective in practice. Experiments show that our algorithm obtains fairness and robustness that are better than or comparable to the state-of-the-art technique, both on synthetic and benchmark real datasets. Moreover, unlike other fair and robust training baselines, our algorithm can be used by only modifying the sampling step in batch selection without changing the training algorithm or leveraging additional clean data.


title: RRNet: Relational Reasoning Network with Parallel Multi-scale Attention for Salient Object Detection in Optical Remote Sensing Images

abstract: Salient object detection (SOD) for optical remote sensing images (RSIs) aims at locating and extracting visually distinctive objects/regions from the optical RSIs. Despite some saliency models were proposed to solve the intrinsic problem of optical RSIs (such as complex background and scale-variant objects), the accuracy and completeness are still unsatisfactory. To this end, we propose a relational reasoning network with parallel multi-scale attention for SOD in optical RSIs in this paper. The relational reasoning module that integrates the spatial and the channel dimensions is designed to infer the semantic relationship by utilizing high-level encoder features, thereby promoting the generation of more complete detection results. The parallel multi-scale attention module is proposed to effectively restore the detail information and address the scale variation of salient objects by using the low-level features refined by multi-scale attention. Extensive experiments on two datasets demonstrate that our proposed RRNet outperforms the existing state-of-the-art SOD competitors both qualitatively and quantitatively.


title: SOAR: Minimizing Network Utilization with Bounded In-network Computing

abstract: In-network computing via smart networking devices is a recent trend for modern datacenter networks. State-of-the-art switches with near line rate computing and aggregation capabilities are developed to enable, e.g., acceleration and better utilization for modern applications like big data analytics, and large-scale distributed and federated machine learning. We formulate and study the problem of activating a limited number of in-network computing devices within a network, aiming at reducing the overall network utilization for a given workload. Such limitations on the number of in-network computing elements per workload arise, e.g., in incremental upgrades of network infrastructure, and are also due to requiring specialized middleboxes, or FPGAs, that should support heterogeneous workloads, and multiple tenants. We present an optimal and efficient algorithm for placing such devices in tree networks with arbitrary link rates, and further evaluate our proposed solution in various scenarios and for various tasks. Our results show that having merely a small fraction of network devices support in-network aggregation can lead to a significant reduction in network utilization. Furthermore, we show that various intuitive strategies for performing such placements exhibit significantly inferior performance compared to our solution, for varying workloads, tasks, and link rates.


title: The Finite Cell Method with Least Squares Stabilized Nitsche Boundary Conditions

abstract: We apply the recently developed least squares stabilized symmetric Nitsche method for enforcement of Dirichlet boundary conditions to the finite cell method. The least squares stabilized Nitsche method in combination with finite cell stabilization leads to a symmetric positive definite stiffness matrix and relies only on elementwise stabilization, which does not lead to additional fill in. We prove a priori error estimates and bounds on the condition numbers.


title: Green Tensor Analysis of Lattice Resonances in Periodic Arrays of Nanoparticles

abstract: When arranged in a periodic geometry, arrays of metallic nanostructures are capable of supporting collective modes known as lattice resonances. These modes, which originate from the coherent multiple scattering between the elements of the array, give rise to very strong and spectrally narrow optical responses. Here, we show that, thanks to their collective nature, the lattice resonances of a periodic array of metallic nanoparticles can mediate an efficient long-range coupling between dipole emitters placed near the array. Specifically, using a coupled dipole approach, we calculate the Green tensor of the array connecting two points and analyze its spectral and spatial characteristics. This quantity represents the electromagnetic field produced by the array at a given position when excited by a unit dipole emitter located at another one. We find that, when a lattice resonance is excited, the Green tensor is significantly larger and decays more slowly with distance than the Green tensor of vacuum. Therefore, in addition to advancing the fundamental understanding of lattice resonances, our results show that periodic arrays of nanostructures are capable of enhancing the long-range coupling between collections of dipole emitters, which makes them a promising platform for applications such as nanoscale energy transfer and quantum information processing.


title: Emoji-based Co-attention Network for Microblog Sentiment Analysis

abstract: Emojis are widely used in online social networks to express emotions, attitudes, and opinions. As emotional-oriented characters, emojis can be modeled as important features of emotions towards the recipient or subject for sentiment analysis. However, existing methods mainly take emojis as heuristic information that fails to resolve the problem of ambiguity noise. Recent researches have utilized emojis as an independent input to classify text sentiment but they ignore the emotional impact of the interaction between text and emojis. It results that the emotional semantics of emojis cannot be fully explored. In this paper, we propose an emoji-based co-attention network that learns the mutual emotional semantics between text and emojis on microblogs. Our model adopts the co-attention mechanism based on bidirectional long short-term memory incorporating the text and emojis, and integrates a squeeze-and-excitation block in a convolutional neural network classifier to increase its sensitivity to emotional semantic features. Experimental results show that the proposed method can significantly outperform several baselines for sentiment analysis on short texts of social media.


title: Usability Inspection: Novice Crowd Inspectors versus Expert

abstract: Objective: This research study aims to investigate the use of novice crowd inspectors for usability inspection with respect to time spent and the cost incurred. This study compares the results of the novice crowd usability inspection guided by a single expert's heuristic usability inspection (novice crowd usability inspection henceforth) with the expert heuristic usability inspection. Background: Traditional usability evaluation methods are time consuming and expensive. Crowdsourcing has emerged as a cost effective and quick means of software usability evaluation. Method: In this regard, we designed an experiment to evaluate the usability of two websites and a web dashboard. Results: The results of the experiment show that novice crowd usability inspection guided by a single expert's heuristic usability inspection: a). Finds the same usability issues (w.r.t. content & quantity) as expert heuristic usability inspection. b). Is cost effective than expert heuristic usability inspection employing less time duration. Conclusion: Based on the findings of this research study, we can conclude that the novice crowd usability inspection guided by a single expert's heuristic usability inspection and expert heuristic usability inspection, on average, gives the same results in terms of issues identified.


title: Extreme values of the Riemann zeta function at its critical points in the critical strip

abstract: We estimate large and small values of $|\zeta(\rho')|$, where $\rho'$ runs over critical points of the zeta function in the right half of the critical strip, that is, the points where $\zeta'(\rho')=0$ and $1/2<\Re \rho'<1$.


title: Systematic definition and classification of data anomalies in DBMS (English Version)

abstract: There is no unified definition of Data anomalies, which refers to the specific data operation mode that may violate the consistency of the database. Known data anomalies include Dirty Write, Dirty Read, Non-repeatable Read, Phantom, Read Skew and Write Skew, etc. In order to improve the efficiency of concurrency control algorithms, data anomalies are also used to define the isolation levels, because the weak isolation level can improve the efficiency of transaction processing systems. This paper systematically studies the data anomalies and the corresponding isolation levels. We report twenty-two new data anomalies that other papers have not reported, and all data anomalies are classified miraculously. Based on the classification of data anomalies, two new isolation levels systems with different granularity are proposed, which reveals the rule of defining isolation levels based on data anomalies and makes the cognition of data anomalies and isolation levels more concise.


title: Probing the thermal history during reionization using a semi-numerical photon-conserving code SCRIPT

abstract: The ionization and thermal state of the intergalactic medium (IGM) during the epoch of reionization has been of interest in recent times because of their close connection to the first stars. We present in this paper a semi-numerical code which computes the large-scale temperature and ionized hydrogen fields in a cosmologically representative volume accounting for the patchiness in these quantities arising from reionization. The code is an extension to a previously developed version for studying the growth of ionized regions, namely, Semi Numerical Code for ReionIzation with PhoTon Conservation (SCRIPT). The main additions in the present version are the inhomogeneous recombinations which are essential for temperature calculations. This extended version of SCRIPT also implements physical consequences of photoheating during reionization, e.g., radiative feedback. These enhancements allow us to predict observables which were not viable with the earlier version. These include the faint-end of the ultra-violet luminosity function of galaxies (which can get affected by the radiative feedback) and the temperature-density relation of the low-density IGM at $z\sim 6$. We study the effect of varying the free parameters and prescriptions of our model on a variety of observables. The conclusion of our analysis is that it should be possible to put constraints on the evolution of thermal and ionization state of the IGM using available observations accounting for all possible variations in the free parameters. A detailed exploration of the parameter space will be taken up in the future.


title: ezcox: An R/CRAN Package for Cox Model Batch Processing and Visualization

abstract: Cox analysis is a common clinical data analysis technique to link valuable variables to clinical outcomes including dead and relapse. In the omics era, Cox model batch processing is a basic strategy for screening clinically relevant variables, biomarker discovery and gene signature identification. However, all such analyses have been implemented with homebrew code in research community, thus lack of transparency and reproducibility. Here, we present ezcox, the first R/CRAN package for Cox model batch processing and visualization. ezcox is an open source R package under GPL-3 license and it is free available at https://github.com/ShixiangWang/ezcox and https://cran.r-project.org/package=ezcox.


title: Zernike mode rescaling extends capabilities of adaptive optics for microscopy

abstract: Zernike polynomials are widely used mathematical models of experimentally observed optical aberrations. Their useful mathematical properties, in particular their orthogonality, make them a ubiquitous basis set for solving various problems in beam optics. Thus they have found widespread use in adaptive optics realizations that are used to correct wavefront aberrations. However, Zernike aberrations lose their orthogonality when used in combination with Gaussian beams, which are omnipresent in real-world optical applications. As a consequence, Zernike aberrations in Gaussian beams start to cross-couple between each other, a phenomenon that does not occur for Zernike aberrations in plane waves. Here, we describe how the aberration radius influences this cross-coupling of Zernike aberrations. Furthermore, we propose that this effect can actually be harnessed to allow efficient compensation of higher-order aberrations using only low-order Zernike modes. This finding has important practical implications, as it suggests the possibility of using adaptive optics devices with low element numbers to compensate aberrations which would normally require more complex and expensive devices.


title: Inferring learners' affinities from course interaction data

abstract: A data-driven model where individual learning behavior is a linear combination of certain stylized learning patterns scaled by learners' affinities is proposed. The absorption of stylized behavior through the affinities constitutes "building blocks" in the model. Non-negative matrix factorization is employed to extract common learning patterns and their affinities from data ensuring meaningful non-negativity of the result. The empirical learning patterns resulting from the actual course interaction data of 111 students are connected to a learning style system. Bootstrap-based inference allows to check the significance of the pattern coefficients. Dividing the learners in two groups "failed" and "passed" and considering their mean affinities leads to a bootstrap-based test on whether the course structure is well-balanced regarding the learning preferences.


title: Algebraic intersection in regular polygons

abstract: We study the function $$\mbox{KVol} : (X,\omega)\mapsto \mbox{Vol} (X,\omega) \sup_{\alpha,\beta} \frac{\mbox{Int} (\alpha,\beta)}{l_g (\alpha) l_g (\beta)}$$ defined on the moduli spaces of translation surfaces. More precisely, let $\mathcal T_n$ be the Teichm\"uller discs of the original Veech surface $(X_n,\omega_n)$ arising from right-angled triangle with angles $(\pi/2,\pi/n,(n-2)\pi/2n)$ by the unfolding construction for $n\geq 5$. For $n \equiv 1 \mod 2$ and any $(X,\omega)\in \mathcal T_n$, we establish the (sharp) bounds $$ \frac{n}{2} \cot \frac{\pi}{n} \leq \mbox{KVol}(X,\omega) \leq \frac{n}{2} \cot \frac{\pi}{n} \cdot \frac1{\sin \frac{2\pi}{n}}.$$ The lower bound is uniquely realized at $(X_n,\omega_n)$.


title: Electron Preacceleration at Weak Quasi-perpendicular Intracluster Shocks: Effects of Preexisting Nonthermal Electrons

abstract: Radio relics in the outskirts of galaxy clusters imply the diffusive shock acceleration (DSA) of electrons at merger-driven shocks with Mach number $M_{s}\lesssim3-4$ in the intracluster medium (ICM). Recent studies have suggested that electron preacceleration and injection, prerequisite steps for DSA, could occur at supercritical shocks with $M_{s}\gtrsim2.3$ in the ICM, thanks to the generation of multiscale waves by microinstabilities such as the Alfv\'en ion cyclotron (AIC) instability, the electron firehose instability (EFI), and the whistler instability (WI). On the other hand, some relics are observed to have subcritical shocks with $M_{s}\lesssim2.3$, leaving DSA at such weak shocks as an outstanding problem. Reacceleration of preexisting nonthermal electrons has been contemplated as one of possible solutions for that puzzle. To explore this idea, we perform Particle-in-Cell (PIC) simulations for weak quasi-perpendicular shocks in high-$\beta$ ($\beta=P_{\rm gas}/P_{B}$) plasmas with power-law suprathermal electrons in addition to Maxwellian thermal electrons. We find that suprathermal electrons enhance the excitation of electron-scale waves via the EFI and WI. However, they do not affect the ion reflection and the ensuing generation of ion-scale waves via the AIC instability. The presence of ion-scale waves is the key for the preacceleration of electrons up to the injection momentum, thus the shock criticality condition for electron injection to DSA is preserved. Based on the results, we conclude that preexisting nonthermal electrons in the preshock region alone would not resolve the issue of electron preacceleration at subcritical ICM shocks.


title: Learning Graph Cellular Automata

abstract: Cellular automata (CA) are a class of computational models that exhibit rich dynamics emerging from the local interaction of cells arranged in a regular lattice. In this work we focus on a generalised version of typical CA, called graph cellular automata (GCA), in which the lattice structure is replaced by an arbitrary graph. In particular, we extend previous work that used convolutional neural networks to learn the transition rule of conventional CA and we use graph neural networks to learn a variety of transition rules for GCA. First, we present a general-purpose architecture for learning GCA, and we show that it can represent any arbitrary GCA with finite and discrete state space. Then, we test our approach on three different tasks: 1) learning the transition rule of a GCA on a Voronoi tessellation; 2) imitating the behaviour of a group of flocking agents; 3) learning a rule that converges to a desired target state.