title: Multi-Party Dual Learning

abstract: The performance of machine learning algorithms heavily relies on the availability of a large amount of training data. However, in reality, data usually reside in distributed parties such as different institutions and may not be directly gathered and integrated due to various data policy constraints. As a result, some parties may suffer from insufficient data available for training machine learning models. In this paper, we propose a multi-party dual learning (MPDL) framework to alleviate the problem of limited data with poor quality in an isolated party. Since the knowledge sharing processes for multiple parties always emerge in dual forms, we show that dual learning is naturally suitable to handle the challenge of missing data, and explicitly exploits the probabilistic correlation and structural relationship between dual tasks to regularize the training process. We introduce a feature-oriented differential privacy with mathematical proof, in order to avoid possible privacy leakage of raw features in the dual inference process. The approach requires minimal modifications to the existing multi-party learning structure, and each party can build flexible and powerful models separately, whose accuracy is no less than non-distributed self-learning approaches. The MPDL framework achieves significant improvement compared with state-of-the-art multi-party learning methods, as we demonstrated through simulations on real-world datasets.


title: Large-Scale Self- and Semi-Supervised Learning for Speech Translation

abstract: In this paper, we improve speech translation (ST) through effectively leveraging large quantities of unlabeled speech and text data in different and complementary ways. We explore both pretraining and self-training by using the large Libri-Light speech audio corpus and language modeling with CommonCrawl. Our experiments improve over the previous state of the art by 2.6 BLEU on average on all four considered CoVoST 2 language pairs via a simple recipe of combining wav2vec 2.0 pretraining, a single iteration of self-training and decoding with a language model. Different to existing work, our approach does not leverage any other supervision than ST data. Code and models will be publicly released.


title: Non-Terrestrial Networks for UAVs: Base Station Service Provisioning Schemes with Antenna Tilt

abstract: By focusing on unmanned aerial vehicle (UAV) communications in non-terrestrial networks (NTNs), this paper provides a guideline on the appropriate base station (BS) service provisioning scheme with considering the antenna tilt angle of BS. Specifically, two service provisioning schemes are considered including the inclusive-service BS (IS-BS) scheme, which makes BSs serve both ground users (GUs) and aerial users (AUs) (i.e., UAVs) simultaneously, and the exclusive-service BS (ES-BS) scheme, which has BSs for GUs and BSs for AUs. By considering the antenna tilt angle-based channel gain, we derive the network outage probability for both IS-BS and ES-BS schemes, and show the existence of the optimal tilt angle that minimizes the network outage probability after analyzing the conflict impact of the antenna tilt angle. We also analyze the impact of various network parameters, including the ratio of GUs to total users and densities of total and interfering BSs, on the network outage probability. Finally, we analytically and numerically show in which environments each service provisioning scheme can be superior to the other one.


title: Wiedemann-Franz law for massless Dirac fermions with implications for graphene

abstract: In the 2016 experiment by Crossno et al. [Science 351, 1058 (2016)], electronic contribution to the thermal conductivity of graphene was found to violate the well-known Wiedemann-Franz (WF) law for metals. At liquid nitrogen temperatures, the thermal to electrical conductivity ratio of charge-neutral samples was more than 10 times higher than predicted by the WF law, what was attributed to interactions between particles leading to collective behavior described by hydrodynamics. Here we show, by adapting the handbook derivation of the WF law to the case of massless Dirac fermions, that significantly enhanced thermal conductivity should appear also in few- or even sub-kelvin temperatures, where the role of interactions can be neglected. The comparison with numerical results obtained within the Landauer-B\"uttiker formalism for rectangular and disk-shaped (Corbino) devices in ballistic graphene is also provided.


title: Towards Time-Optimal Any-Angle Path Planning With Dynamic Obstacles

abstract: Path finding is a well-studied problem in AI, which is often framed as graph search. Any-angle path finding is a technique that augments the initial graph with additional edges to build shorter paths to the goal. Indeed, optimal algorithms for any-angle path finding in static environments exist. However, when dynamic obstacles are present and time is the objective to be minimized, these algorithms can no longer guarantee optimality. In this work, we elaborate on why this is the case and what techniques can be used to solve the problem optimally. We present two algorithms, grounded in the same idea, that can obtain provably optimal solutions to the considered problem. One of them is a naive algorithm and the other one is much more involved. We conduct a thorough empirical evaluation showing that, in certain setups, the latter algorithm might be as fast as the previously-known greedy non-optimal solver while providing solutions of better quality. In some (rare) cases, the difference in cost is up to 76%, while on average it is lower than one percent (the same cost difference is typically observed between optimal and greedy any-angle solvers in static environments).


title: Defects in Crystals of Soft Colloidal Particles

abstract: In this paper we use computer simulations to examine point defects in systems of "soft" colloidal particles including Hertzian spheres, and star polymers. We use Monte Carlo simulations to determine the deformation of the different crystals associated with vacancies and interstitials and use thermodynamic integration to predict the equilibrium concentrations of such defects. We find that the nature of the lattice distortion is mainly determined by the crystal structure and not by the specifics of the interaction potential. We can distinguish one-, two-, and three-dimensional lattice distortions and find that the range of the distortion generally depends on the dimensionality. We find that in both model systems the deformation of the body-centered cubic (BCC) crystal caused by an interstitial is one-dimensional and we show that its structure is well described as a crowdion. Similarly, we show that the one-dimensional deformation of the hexagonal (H) crystal of Hertzian spheres caused by a vacancy can be characterized as a voidion. Interestingly, with the exception of the FCC crystal in the Hertzian sphere model, in all cases we find that the interstitial concentration is higher than the vacancy concentration. Most noteworthy, the concentration of interstitials in the BCC crystals can reach up to 1%.


title: The Curious Case of Hallucinations in Neural Machine Translation

abstract: In this work, we study hallucinations in Neural Machine Translation (NMT), which lie at an extreme end on the spectrum of NMT pathologies. Firstly, we connect the phenomenon of hallucinations under source perturbation to the Long-Tail theory of Feldman (2020), and present an empirically validated hypothesis that explains hallucinations under source perturbation. Secondly, we consider hallucinations under corpus-level noise (without any source perturbation) and demonstrate that two prominent types of natural hallucinations (detached and oscillatory outputs) could be generated and explained through specific corpus-level noise patterns. Finally, we elucidate the phenomenon of hallucination amplification in popular data-generation processes such as Backtranslation and sequence-level Knowledge Distillation.


abstract: This note concerns Loomis-Whitney inequalities in Heisenberg groups $\mathbb{H}^n$: $$|K| \lesssim \prod_{j=1}^{2n}|\pi_j(K)|^{\frac{n+1}{n(2n+1)}}, \qquad K \subset \mathbb{H}^n.$$ Here $\pi_{j}$, $j=1,\ldots,2n$, are the vertical Heisenberg projections to the hyperplanes $\{x_j=0\}$, respectively, and $|\cdot|$ refers to a natural Haar measure on either $\mathbb{H}^n$, or one of the hyperplanes. The Loomis-Whitney inequality in the first Heisenberg group $\mathbb{H}^1$ is a direct consequence of known $L^p$ improving properties of the standard Radon transform in $\mathbb{R}^2$. In this note, we show how the Loomis-Whitney inequalities in higher dimensional Heisenberg groups can be deduced by an elementary inductive argument from the inequality in $\mathbb{H}^1$. The same approach, combined with multilinear interpolation, also yields the following strong type bound: $$\int_{\mathbb{H}^n} \prod_{j=1}^{2n} f_j(\pi_j(p))\;dp\lesssim \prod_{j=1}^{2n} \|f_j\|_{\frac{n(2n+1)}{n+1}}$$ for all nonnegative measurable functions $f_1,\ldots,f_{2n}$ on $\mathbb{R}^{2n}$. These inequalities and their geometric corollaries are thus ultimately based on planar geometry. Among the applications of Loomis-Whitney inequalities in $\mathbb{H}^n$, we mention the following sharper version of the classical geometric Sobolev inequality in $\mathbb{H}^n$: $$\|u\|_{\frac{2n+2}{2n+1}} \lesssim \prod_{j=1}^{2n}\|X_ju\|^{\frac{1}{2n}}, \qquad u \in BV(\mathbb{H}^n),$$ where $X_j$, $j=1,\ldots,2n$, are the standard horizontal vector fields in $\mathbb{H}^n$.


title: BROADCAST: Reducing Both Stochastic and Compression Noise to Robustify Communication-Efficient Federated Learning

abstract: Communication between workers and the master node to collect local stochastic gradients is a key bottleneck in a large-scale federated learning system. Various recent works have proposed to compress the local stochastic gradients to mitigate the communication overhead. However, robustness to malicious attacks is rarely considered in such a setting. In this work, we investigate the problem of Byzantine-robust compressed federated learning, where the attacks from Byzantine workers can be arbitrarily malicious. We theoretically point out that different to the attacks-free compressed stochastic gradient descent (SGD), its vanilla combination with geometric median-based robust aggregation seriously suffers from the compression noise in the presence of Byzantine attacks. In light of this observation, we propose to reduce the compression noise with gradient difference compression so as to improve the Byzantine-robustness. We also observe the impact of the intrinsic stochastic noise caused by selecting random samples, and adopt the stochastic average gradient algorithm (SAGA) to gradually eliminate the inner variations of regular workers. We theoretically prove that the proposed algorithm reaches a neighborhood of the optimal solution at a linear convergence rate, and the asymptotic learning error is in the same order as that of the state-of-the-art uncompressed method. Finally, numerical experiments demonstrate the effectiveness of the proposed method.


title: Underwater dual-magnification imaging for automated lake plankton monitoring

abstract: We present an approach for automated in-situ monitoring of phytoplankton and zooplankton communities based on a dual magnification dark-field imaging microscope/camera. We describe the Dual Scripps Plankton Camera (DSPC) system and associated image processing, and assess its capabilities in detecting and characterizing plankton species of different size and taxonomic categories, and in measuring their abundances in both laboratory and field applications. In the laboratory, body size and abundance estimates by the DSPC significantly and robustly scale with the same measurements derived by traditional microscopy. In the field, a DSPC installed permanently at 3 m depth in Lake Greifensee (Switzerland), delivered images of plankton individuals, colonies, and heterospecific aggregates without disrupting natural arrangements of interacting organisms, their microenvironment or their behavior at hourly timescales. The DSPC was able to track the dynamics of taxa in the size range between ~10 $\mu$m to ~ 1 cm, covering virtually all the components of the planktonic food web (including parasites and potentially toxic cyanobacteria). Comparing data from the field-deployed DSPC to traditional sampling and microscopy revealed a general overall agreement in estimates of plankton diversity and abundances, despite imaging limitations in detecting small phytoplankton species and rare and large zooplankton taxa (e.g. carnivorous zooplankton). The most significant disagreements between traditional methods and the DSPC resided in the measurements of community properties of zooplankton, organisms that are heterogeneously distributed spatially and temporally, and whose demography appeared to be better captured by automated imaging. Time series collected by the DSPC depicted ecological succession patterns, algal bloom dynamics and circadian fluctuations with a temporal frequency and morphological [continues...]


title: Reward function shape exploration in adversarial imitation learning: an empirical study

abstract: For adversarial imitation learning algorithms (AILs), no true rewards are obtained from the environment for learning the strategy. However, the pseudo rewards based on the output of the discriminator are still required. Given the implicit reward bias problem in AILs, we design several representative reward function shapes and compare their performances by large-scale experiments. To ensure our results' reliability, we conduct the experiments on a series of Mujoco and Box2D continuous control tasks based on four different AILs. Besides, we also compare the performance of various reward function shapes using varying numbers of expert trajectories. The empirical results reveal that the positive logarithmic reward function works well in typical continuous control tasks. In contrast, the so-called unbiased reward function is limited to specific kinds of tasks. Furthermore, several designed reward functions perform excellently in these environments as well.


title: Fundamental entropic processes in the theory of optical thermodynamics

abstract: We study the statistical behavior of multimoded optical systems under equilibrium conditions. We investigate the role of variations of the system parameters in the thermodynamic description and derive, an optical analogue of the first law of thermodynamics, a generic expression for the work done to the system, and an optical Gibbs-Duhem equation. To demonstrate these effects, we focus in the case of two-dimensional photonic lattices. We study the conditions under which the entropy in such waveguide arrays can be considered as extensive. In this respect, small deviations from the extensive character of the entropy give rise to stress and strain terms. We examine how the conservation laws in such array configurations are affected by variations in the system parameters, and furthermore, we analyze the respective thermodynamic processes (isentropic and Joule-type expansions).


title: Learning Normal Dynamics in Videos with Meta Prototype Network

abstract: Frame reconstruction (current or future frame) based on Auto-Encoder (AE) is a popular method for video anomaly detection. With models trained on the normal data, the reconstruction errors of anomalous scenes are usually much larger than those of normal ones. Previous methods introduced the memory bank into AE, for encoding diverse normal patterns across the training videos. However, they are memory-consuming and cannot cope with unseen new scenarios in the testing data. In this work, we propose a dynamic prototype unit (DPU) to encode the normal dynamics as prototypes in real time, free from extra memory cost. In addition, we introduce meta-learning to our DPU to form a novel few-shot normalcy learner, namely Meta-Prototype Unit (MPU). It enables the fast adaption capability on new scenes by only consuming a few iterations of update. Extensive experiments are conducted on various benchmarks. The superior performance over the state-of-the-art demonstrates the effectiveness of our method.


title: Nonlinear Hall effect with time-reversal symmetry: Theory and material realizations

abstract: The appearance of a Hall conductance necessarily requires breaking of time-reversal symmetry, either by an external magnetic field or by the internal magnetization of a material. However, as a second response, Hall dissipationless transverse currents can appear even in time-reversal symmetric conditions in non-centrosymmetric materials. Moreover, this non-linear effect has a quantum origin: it is related to the geometric properties of the electronic wavefunctions and encoded in the dipole moment of the Berry curvature. Here we review the general theory underpinning this effect and discuss various material platforms where non-linear Hall transverse responses have been theoretically proposed and experimentally verified. On the theoretical front, the link between the non-linear Hall effect and the Berry curvature dipole is discussed using Boltzmann transport theory. On the material front, different platforms, including topological crystalline insulators, transition metal dichalcogenides, graphene, and Weyl semimetals are reviewed.


title: Consistency between dynamical and thermodynamical stabilities for charged self-gravitating perfect fluid

abstract: The entropy principle shows that, for self-gravitating perfect fluid, the Einstein field equations can be derived from the extrema of the total entropy, and the thermodynamical stability criterion are equivalent to the dynamical stability criterion. In this paper, we recast the dynamical criterion for the charged self-gravitating perfect fluid in Einstein-Maxwell theory, and further give the criterion of the star with barotropic condition. In order to obtain the thermodynamical stability criterion, first we get the general formula of the second variation of the total entropy for charged perfect fluid case, and then obtain the thermodynamical criterion for radial perturbation. We show that these two stability criterion are the same, which suggest that the inherent connection between gravity and thermodynamic even when the electric field is taken into account.


title: On the role of resonances in polluting white dwarfs by asteroids

abstract: Pollution of white dwarf atmospheres may be caused by asteroids that originate from the locations of secular and mean-motion resonances in planetary systems. Asteroids in these locations experience increased eccentricity, leading to tidal disruption by the white dwarf. We examine how the $\nu_6$ secular resonance shifts outwards into a previously stable region of the asteroid belt, as the star evolves to a white dwarf. Analytic secular models require a planet to be engulfed in order to shift the resonance. We show with numerical simulations that as a planet gets engulfed by the evolving star, the secular resonance shifts and the rate of tidal disruption events increases with the engulfed planet's mass and its orbital separation. We also investigate the behaviour of mean-motion resonances. The width of a mean-motion resonance increases as the star loses mass and becomes a white dwarf. The $\nu_6$ secular resonance is more efficient at driving tidal disruptions than mean-motion resonances with Jupiter. By examining 230 observed exoplanetary systems whose central star will evolve into a white dwarf, we find that along with an Earth mass planet at $1\,\rm au$, hot Jupiters at a semi--major axis $a\gtrsim 0.05\,\rm au$ and super--Earths of mass $10\,\rm M_\oplus$ at $a\gtrsim 0.3\,\rm au$ represent planet types whose engulfment shifts resonances enough to cause pollution of the white dwarfs to a degree in agreement with observations.


title: The momentum distribution of two bosons in one dimension with infinite contact repulsion in harmonic trap gets analytical

abstract: For a harmonically trapped system consisting of two bosons in one spatial dimension with infinite contact repulsion (hard core bosons), we derive an expression for the one-body density matrix $\rho_B$ in terms of centre of mass and relative coordinates of the particles. The deviation from $\rho_F$, the density matrix for the two fermions case, can be clearly identified. Moreover, the obtained $\rho_B$ allows us to derive a closed form expression of the corresponding momentum distribution $n_{B}(p)$. We show how the result deviates from the noninteracting fermionic case, the deviation being associated to the short range character of the interaction. Mathematically, our analytical momentum distribution is expressed in terms of one and two variables confluent hypergeometric functions. Our formula satisfies the correct normalization and possesses the expected behavior at zero momentum. It also exhibits the high momentum $1/p^4 $ tail with the appropriate Tan's coefficient. Numerical results support our findings.


title: Line graph characterization of power graphs of finite nilpotent groups

abstract: This paper deals with the classification of groups $G$ such that power graphs and proper power graphs of $G$ are line graphs. In fact, we classify all finite nilpotent groups whose power graphs are line graphs. Also, we categorize all finite nilpotent groups (except non-abelian $2$-groups) whose proper power graphs are line graphs. Moreover, we investigate when the proper power graphs of generalized quaternion groups are line graphs. Besides, we derive a condition on the order of the dihedral groups for which the proper power graphs of the dihedral groups are line graphs.


title: Improving Optimal Power Flow Relaxations Using 3-Cycle Second-Order Cone Constraints

abstract: This paper develops a novel second order cone relaxation of the semidefinite programming formulation of optimal power flow, that does not imply the `angle relaxation'. We build on a technique developed by Kim et al., extend it for complex matrices, and apply it to 3x3 positive semidefinite matrices to generate novel second-order cone constraints that augment upon the well-known 2x2 principal-minor based second-order cone constraints. Finally, we apply it to optimal power flow in meshed networks and provide numerical illustrations.


title: Cost-constrained Minimal Steiner Tree Enumeration by Binary Decision Diagram

abstract: The Steiner tree enumeration problem is a well known problem that asks for enumerating Steiner trees. Numerous theoretical works proposed algorithms for the problem and analyzed their complexity, but there are no practical algorithms and experimental studies. In this paper, we study the Steiner tree enumeration problem practically. We define a problem cost-constrained minimal Steiner tree enumeration problem, which enumerates minimal Steiner trees with costs not larger than a given threshold. To solve the problem, we propose a binary decision diagram (BDD)-based algorithm. The BDD-based algorithm constructs a BDD that compactly represents the set of minimal Steiner trees and then traverses the BDD for enumeration. We develop a novel {\it frontier-based algorithm} to efficiently construct BDDs. Our BDD traverse algorithm prunes Steiner trees with costs larger than the threshold. We also extend our algorithm by preprocessing the given graph and controlling the number of generated Steiner trees in order to reduce the memory and computation costs. The extension makes our algorithm scalable by generating a subset of the minimal Steiner trees. We validate that our algorithm can enumerate Steiner trees in real-world graphs more efficiently than existing methods.


title: Revisiting Hierarchical Approach for Persistent Long-Term Video Prediction

abstract: Learning to predict the long-term future of video frames is notoriously challenging due to inherent ambiguities in the distant future and dramatic amplifications of prediction error through time. Despite the recent advances in the literature, existing approaches are limited to moderately short-term prediction (less than a few seconds), while extrapolating it to a longer future quickly leads to destruction in structure and content. In this work, we revisit hierarchical models in video prediction. Our method predicts future frames by first estimating a sequence of semantic structures and subsequently translating the structures to pixels by video-to-video translation. Despite the simplicity, we show that modeling structures and their dynamics in the discrete semantic structure space with a stochastic recurrent estimator leads to surprisingly successful long-term prediction. We evaluate our method on three challenging datasets involving car driving and human dancing, and demonstrate that it can generate complicated scene structures and motions over a very long time horizon (i.e., thousands frames), setting a new standard of video prediction with orders of magnitude longer prediction time than existing approaches. Full videos and codes are available at https://1konny.github.io/HVP/.


title: s-wave superconductivity in kagome metal CsV$_{3}$Sb$_{5}$ revealed by $^{121/123}$Sb NQR and $^{51}$V NMR measurements

abstract: We report $^{121/123}$Sb nuclear quadrupole resonance (NQR) and $^{51}$V nuclear magnetic resonance (NMR) measurements on kagome metal CsV$_3$Sb$_5$ with $T_{\rm c}=2.5$ K. Both $^{51}$V NMR spectra and $^{121/123}$Sb NQR spectra split after a charge density wave (CDW) transition, which demonstrates a commensurate CDW state. The coexistence of the high temperature phase and the CDW phase between $91$ K and $94$ K manifests that it is a first order phase transition. At low temperature, electric-field-gradient fluctuations diminish and magnetic fluctuations become dominant. Superconductivity emerges in the charge order state. Knight shift decreases and $1/T_{1}T$ shows a Hebel--Slichter coherence peak just below $T_{\rm c}$, indicating that CsV$_3$Sb$_5$ is an s-wave superconductor.


title: Change Detection in Synthetic Aperture Radar Images Using a Dual-Domain Network

abstract: Change detection from synthetic aperture radar (SAR) imagery is a critical yet challenging task. Existing methods mainly focus on feature extraction in spatial domain, and little attention has been paid to frequency domain. Furthermore, in patch-wise feature analysis, some noisy features in the marginal region may be introduced. To tackle the above two challenges, we propose a Dual-Domain Network. Specifically, we take features from the discrete cosine transform domain into consideration and the reshaped DCT coefficients are integrated into the proposed model as the frequency domain branch. Feature representations from both frequency and spatial domain are exploited to alleviate the speckle noise. In addition, we further propose a multi-region convolution module, which emphasizes the central region of each patch. The contextual information and central region features are modeled adaptively. The experimental results on three SAR datasets demonstrate the effectiveness of the proposed model. Our codes are available at https://github.com/summitgao/SAR_CD_DDNet.


title: DistGNN: Scalable Distributed Training for Large-Scale Graph Neural Networks

abstract: Full-batch training on Graph Neural Networks (GNN) to learn the structure of large graphs is a critical problem that needs to scale to hundreds of compute nodes to be feasible. It is challenging due to large memory capacity and bandwidth requirements on a single compute node and high communication volumes across multiple nodes. In this paper, we present DistGNN that optimizes the well-known Deep Graph Library (DGL) for full-batch training on CPU clusters via an efficient shared memory implementation, communication reduction using a minimum vertex-cut graph partitioning algorithm and communication avoidance using a family of delayed-update algorithms. Our results on four common GNN benchmark datasets: Reddit, OGB-Products, OGB-Papers and Proteins, show up to 3.7x speed-up using a single CPU socket and up to 97x speed-up using 128 CPU sockets, respectively, over baseline DGL implementations running on a single CPU socket


title: Smart City Data Analysis via Visualization of Correlated Attribute Patterns

abstract: Urban conditions are monitored by a wide variety of sensors that measure several attributes, such as temperature and traffic volume. The correlations of sensors help to analyze and understand the urban conditions accurately. The correlated attribute pattern (CAP) mining discovers correlations among multiple attributes from the sets of sensors spatially close to each other and temporally correlated in their measurements. In this paper, we develop a visualization system for CAP mining and demonstrate analysis of smart city data. Our visualization system supports an intuitive understanding of mining results via sensor locations on maps and temporal changes of their measurements. In our demonstration scenarios, we provide four smart city datasets collected from China and Santander, Spain. We demonstrate that our system helps interactive analysis of smart city data.


title: Out-of-Step Detection Based On an Improved Line Potential Energy Criterion

abstract: The line potential energy in the cutset is used as the criterion for monitoring the generator instability, but the criterion has the following two limitations due to narrowly defined conditions. The assumption of an ideal constant power load is difficult to satisfy, and the condition of the critical cutset is too narrow. The limitations are addressed by analyzing the relationship between the power of the load elements and the power of the cutset based on the two-machine equivalent. Modifications of the theoretical derivation steps of this criterion are presented to extend the applications of the criterion and provide theoretical support for its online use. Two simple strategies are proposed to ensure early detection of the generator instability.


title: Deep Permutation Equivariant Structure from Motion

abstract: Existing deep methods produce highly accurate 3D reconstructions in stereo and multiview stereo settings, i.e., when cameras are both internally and externally calibrated. Nevertheless, the challenge of simultaneous recovery of camera poses and 3D scene structure in multiview settings with deep networks is still outstanding. Inspired by projective factorization for Structure from Motion (SFM) and by deep matrix completion techniques, we propose a neural network architecture that, given a set of point tracks in multiple images of a static scene, recovers both the camera parameters and a (sparse) scene structure by minimizing an unsupervised reprojection loss. Our network architecture is designed to respect the structure of the problem: the sought output is equivariant to permutations of both cameras and scene points. Notably, our method does not require initialization of camera parameters or 3D point locations. We test our architecture in two setups: (1) single scene reconstruction and (2) learning from multiple scenes. Our experiments, conducted on a variety of datasets in both internally calibrated and uncalibrated settings, indicate that our method accurately recovers pose and structure, on par with classical state of the art methods. Additionally, we show that a pre-trained network can be used to reconstruct novel scenes using inexpensive fine-tuning with no loss of accuracy.


title: The inverse spectral problem for quantum semitoric systems

abstract: Given a quantum semitoric system composed of pseudodifferential operators, Berezin-Toeplitz operators, or a combination of both, we obtain explicit formulas for recovering, from the semiclassical asymptotics of the joint spectrum, all symplectic invariants of the underlying classical semitoric system. Our formulas are based on the possibility to obtain good quantum numbers for joint eigenvalues from the bare data of the joint spectrum. In the spectral region corresponding to regular values of the momentum map, the algorithms developed by Dauge, Hall and the second author [27] produce such labellings. In our proof, it was crucial to extend these algorithms to the boundary of the spectrum, which led to the new notion of asymptotic half-lattices, and to globalize the resulting labellings. Using the construction given by Pelayo and the second author in [79], our results prove that semitoric systems are completely spectrally determined in an algorithmic way~: from the joint spectrum of a quantum semitoric system one can construct a representative of the isomorphism class of the underlying classical semitoric system. In particular, this recovers the uniqueness result obtained by Pelayo and the authors in [62,61], and completes it with the explicit computation of all invariants, including the twisting index. In the cases of the spin-oscillator and the coupled angular momenta, we implement the algorithms and illustrate numerically the computation of the invariants from the joint spectrum.


title: A User's Guide to Morse Foliated Open Books

abstract: Morse foliated open books were introduced by the autors (along with abstract and embedded versions) as a tool for studying contact manifolds with boundary, and this article illustrates the advantages of the Morse perspective. We use this to extend the definition of \textit{right-veering} to foliated open books and we show that it plays a similar role in detecting overtwistedness as in other versions of open books.


title: Towards Off-the-grid Algorithms for Total Variation Regularized Inverse Problems

abstract: We introduce an algorithm to solve linear inverse problems regularized with the total (gradient) variation in a gridless manner. Contrary to most existing methods, that produce an approximate solution which is piecewise constant on a fixed mesh, our approach exploits the structure of the solutions and consists in iteratively constructing a linear combination of indicator functions of simple polygons.


title: Modelling instabilities in electroelastic and magnetoelastic membranes: a very brief review

abstract: The current state of the art for analytical and computational modelling of deformation in nonlinear electroelastic and magnetoelastic membranes is reviewed. A general framework and a list of methods to model large deformation and associated instabilities (wrinkling, limit point, global bifurcation) due to coupled electromechanical or magnetoemechanical loading is presented.


title: Deep Nonparametric Regression on Approximate Manifolds: Non-Asymptotic Error Bounds with Polynomial Prefactors

abstract: We study the properties of nonparametric least squares regression using deep neural networks. We derive non-asymptotic upper bounds for the prediction error of the empirical risk minimizer of feedforward deep neural regression. Our error bounds achieve minimax optimal rate and significantly improve over the existing ones in the sense that they depend polynomially on the dimension of the predictor, instead of exponentially on dimension. We show that the neural regression estimator can circumvent the curse of dimensionality under the assumption that the predictor is supported on an approximate low-dimensional manifold or a set with low Minkowski dimension. We also establish the optimal convergence rate under the exact manifold support assumption. We investigate how the prediction error of the neural regression estimator depends on the structure of neural networks and propose a notion of network relative efficiency between two types of neural networks, which provides a quantitative measure for evaluating the relative merits of different network structures. To establish these results, we derive a novel approximation error bound for the H\"older smooth functions with a positive smoothness index using ReLU activated neural networks, which may be of independent interest. Our results are derived under weaker assumptions on the data distribution and the neural network structure than those in the existing literature.


title: Towards BERT-based Automatic ICD Coding: Limitations and Opportunities

abstract: Automatic ICD coding is the task of assigning codes from the International Classification of Diseases (ICD) to medical notes. These codes describe the state of the patient and have multiple applications, e.g., computer-assisted diagnosis or epidemiological studies. ICD coding is a challenging task due to the complexity and length of medical notes. Unlike the general trend in language processing, no transformer model has been reported to reach high performance on this task. Here, we investigate in detail ICD coding using PubMedBERT, a state-of-the-art transformer model for biomedical language understanding. We find that the difficulty of fine-tuning the model on long pieces of text is the main limitation for BERT-based models on ICD coding. We run extensive experiments and show that despite the gap with current state-of-the-art, pretrained transformers can reach competitive performance using relatively small portions of text. We point at better methods to aggregate information from long texts as the main need for improving BERT-based ICD coding.


title: Students Struggle to Explain Their Own Program Code

abstract: We asked students to explain the structure and execution of their small programs after they had submitted them to a programming exercise. These questions about learner's code (QLCs) were delivered at three occasions in an online and open course in introductory programming as a part of the digital learning material. We make inductive content analysis to research the open-ended text answers we collected. One third of the students struggled to explain their own program code. This estimates possible occurrences of fragile learning at the moment when a student seemingly succeeds in a program writing exercise. Furthermore, we examine correlations between the correctness of the answers with other learning data. Our results indicate that answering properly aligned QLCs correctly has stronger correlation with student success and retention than merely submitting a correct program. Additionally, we present observations on learning event-driven programming to explore QLCs' potential in identifying students' thinking process.


title: Collisional Growth and Fragmentation of Dust Aggregates with Low Mass Ratios. I: Critical Collision Velocity for Water Ice

abstract: We investigated fundamental processes of collisional sticking and fragmentation of dust aggregates by carrying out N-body simulations of submicron-sized icy dust monomers. We examined the condition for collisional growth of two colliding dust aggregates in a wide range of the mass ratio, 1-64. We found that the mass transfer from a larger dust aggregate to a smaller one is a dominant process in collisions with a mass ratio of 2-30 and impact velocity of \approx 30-170 m s^-1. As a result, the critical velocity, v_fra, for fragmentation of the largest body is considerably reduced for such unequal-mass collisions; v_fra of collisions with a mass ratio of 3 is about half of that obtained from equal-mass collisions. The impact velocity is generally higher for collisions between dust aggregates with higher mass ratios because of the difference between the radial drift velocities in the typical condition of protoplanetary disks. Therefore, the reduced v_fra for unequal-mass collisions would delay growth of dust grains in the inner region of protoplanetary disks.


title: Coexistence of vortex arrays and surface capillary waves in spinning prolate superfluid He-4 nanodroplets

abstract: Within Density Functional Theory, we have studied the interplay between vortex arrays and capillary waves in spinning prolate He-4 droplets made of several thousands of helium atoms. Surface capillary waves are ubiquitous in prolate superfluid He-4 droplets and, depending on the size and angular momentum of the droplet, they may coexist with vortex arrays. We have found that the equilibrium configuration of small prolate droplets is vortex-free, evolving towards vortex-hosting as the droplet size increases. This result is in agreement with a recent experiment [S.M. O'Connell et al., Phys. Rev. Lett. 124, 215301 (2020)], where it has been disclosed that vortex arrays and capillary waves coexist in the equilibrium configuration of very large drops. Contrarily to viscous droplets executing rigid body rotation, the stability phase diagram of spinning He-4 droplets cannot be universally described in terms of dimensionless angular momentum and angular velocity variables: instead, the rotational properties of superfluid helium droplets display a clear dependence on the droplet size and the number of vortices they host.


title: Semitopological modules

abstract: Given a topological ring $R$, we study semitopological $R$-modules, construct their completions, Bohr and borno modifications. For every topological space $X$, we construct the free (semi)topological $R$-module over $X$ and prove that for a $k$-space $X$ its free semitopological $R$-module is a topological $R$-module. Also we construct a Tychonoff space $X$ whose free semitopological $R$-module is not a topological $R$-module.


title: Lazy Parameter Tuning and Control: Choosing All Parameters Randomly From a Power-Law Distribution

abstract: Most evolutionary algorithms have multiple parameters and their values drastically affect the performance. Due to the often complicated interplay of the parameters, setting these values right for a particular problem (parameter tuning) is a challenging task. This task becomes even more complicated when the optimal parameter values change significantly during the run of the algorithm since then a dynamic parameter choice (parameter control) is necessary. In this work, we propose a lazy but effective solution, namely choosing all parameter values (where this makes sense) in each iteration randomly from a suitably scaled power-law distribution. To demonstrate the effectiveness of this approach, we perform runtime analyses of the $(1+(\lambda,\lambda))$ genetic algorithm with all three parameters chosen in this manner. We show that this algorithm on the one hand can imitate simple hill-climbers like the $(1+1)$ EA, giving the same asymptotic runtime on problems like OneMax, LeadingOnes, or Minimum Spanning Tree. On the other hand, this algorithm is also very efficient on jump functions, where the best static parameters are very different from those necessary to optimize simple problems. We prove a performance guarantee that is comparable to the best performance known for static parameters. For the most interesting case that the jump size $k$ is constant, we prove that our performance is asymptotically better than what can be obtained with any static parameter choice. We complement our theoretical results with a rigorous empirical study confirming what the asymptotic runtime results suggest.


title: Bispropylurea bridged polysilsesquioxane: A microporous MOF-like material for molecular recognition

abstract: Microporous organosilicas assembled from polysilsesquioxane (POSS) building blocks are promising materials that are yet to be explored in-depth. Here, we investigate the processing and molecular structure of bispropylurea bridged POSS (POSS-urea), synthesised through the acidic condensation of 1,3-bis(3-(triethoxysilyl)propyl)urea (BTPU). Experimentally, we show that POSS-urea has excellent functionality for molecular recognition toward acetonitrile with an adsorption level of 74 mmol/g, which compares favourably to MOFs and zeolites, with applications in volatile organic compounds (VOC). The acetonitrile adsorption capacity was 132-fold higher relative to adsorption capacity for toluene, which shows the pores are highly selective towards acetonitrile adsorption due to their size and arrangement. Theoretically, our tight-binding density functional and molecular dynamics calculations demonstrated that this BTPU based POSS is microporous with an irregular placement of the pores. Structural studies confirm maximal pore sizes of around 1 nm, with POSS cages possessing an approximate edge length of approximately 3.16 Angstrom


title: On the distribution of Sudler products and Birkhoff sums for the irrational rotation

abstract: We study the value distribution of the Sudler product $\prod_{n=1}^N |2 \sin (\pi n \alpha )|$ and the Diophantine product $\prod_{n=1}^N (2e\| n \alpha \|)$ for various irrational $\alpha$, as $N$ ranges in a long interval of integers. At badly approximable irrationals these products exhibit strong concentration around $N^{1/2}$, and at certain quadratic irrationals they even satisfy a central limit theorem. In contrast, at almost every $\alpha$ we observe an interesting anticoncentration phenomenon when the typical and the extreme values are of the same order of magnitude. Our methods are equally suited for the value distribution of Birkhoff sums $\sum_{n=1}^N f(n \alpha )$ for circle rotations. Using Diophantine approximation and Fourier analysis, we find the first and second moment for an arbitrary periodic $f$ of bounded variation, and (almost) prove a conjecture of Bromberg and Ulcigrai on the appropriate scaling factor in a so-called temporal limit theorem. Birkhoff sums also satisfy a central limit theorem at certain quadratic irrationals.


title: Note on Improved Bohr Inequality for harmonic mappings

abstract: In this paper, we give a new generalization of the Bohr inequality in refined form both for bounded analytic functions, and for sense-preserving harmonic functions with analytic part being bounded.


title: Improved Branch and Bound for Neural Network Verification via Lagrangian Decomposition

abstract: We improve the scalability of Branch and Bound (BaB) algorithms for formally proving input-output properties of neural networks. First, we propose novel bounding algorithms based on Lagrangian Decomposition. Previous works have used off-the-shelf solvers to solve relaxations at each node of the BaB tree, or constructed weaker relaxations that can be solved efficiently, but lead to unnecessarily weak bounds. Our formulation restricts the optimization to a subspace of the dual domain that is guaranteed to contain the optimum, resulting in accelerated convergence. Furthermore, it allows for a massively parallel implementation, which is amenable to GPU acceleration via modern deep learning frameworks. Second, we present a novel activation-based branching strategy. By coupling an inexpensive heuristic with fast dual bounding, our branching scheme greatly reduces the size of the BaB tree compared to previous heuristic methods. Moreover, it performs competitively with a recent strategy based on learning algorithms, without its large offline training cost. Finally, we design a BaB framework, named Branch and Dual Network Bound (BaDNB), based on our novel bounding and branching algorithms. We show that BaDNB outperforms previous complete verification systems by a large margin, cutting average verification times by factors up to 50 on adversarial robustness properties.


title: Sentence Embeddings by Ensemble Distillation

abstract: This paper contributes a new State Of The Art (SOTA) for Semantic Textual Similarity (STS). We compare and combine a number of recently proposed sentence embedding methods for STS, and propose a novel and simple ensemble knowledge distillation scheme that improves on previous approaches. Our experiments demonstrate that a model trained to learn the average embedding space from multiple ensemble students outperforms all the other individual models with high robustness. Utilizing our distillation method in combination with previous methods, we significantly improve on the SOTA unsupervised STS, and by proper hyperparameter tuning of previous methods we improve the supervised SOTA scores.


title: The TopFlavor scheme in the context of $W'$ searches at LHC

abstract: Many extensions of the Standard Model predict the existence of new charged or neutral gauge bosons, with a wide variety of phenomenological implications depending on the model adopted. The search for such particles is extensively carried through at the Large Hadron Collider (LHC), and it is therefore of crucial importance to have for each proposed scenario quantitative predictions that can be matched to experiments. In this work we focus on the implications of one of these models, the TopFlavor Model, proposing a charged $\text{W}^\prime$ boson that has preferential couplings to the third generation fermions. We compare such predictions to the ones from the so called Sequential Standard Model (SSM), that is used as benchmark, being one of the simplest and most commonly considered models for searches at the LHC. We identify the parameter space still open for searches at the LHC, and in particular we show that the cross section for the processes $pp \to \text{W}^\prime \to \tau \nu$ and $pp \to \text{W}^\prime \to tb$ can be up to two orders of magnitude smaller with respect to the SSM, depending on the free parameters of the model, like the particle mass and its width. This study makes the case for further searches at the LHC, and shows how a complete and systematic model independent analysis of $\text{W}^\prime$ boson phenomenology at colliders is essential to provide guidance for future searches.


title: Anomalous Hall signatures of nonsymmorphic nodal lines in doped chromium chalcospinel CuCr$_2$Se$_4$

abstract: An emerging phase of matter among the class of topological materials is nodal line semimetal, possessing symmetry-protected one-dimensional gapless lines at the (or close to) the Fermi level in $k$-space. When the $k$-dispersion of the nodal line is weak, van Hove singularities generated by the almost flat nodal lines may be prone to instabilities introduced by additional perturbations such as spin-orbit coupling or magnetism. Here, we study Cr-based ferromagnetic chalcospinel compound CuCr$_2$Se$_4$ (CCS) via first-principles electronic structure methods and reveal the true origin of its dissipationless anomalous Hall conductivity, which was not well understood previously. We find that CCS hosts nodal lines protected by nonsymmorphic symmetries, located in the vicinity of Fermi level, and that such nodal lines are the origin of the previously observed distinct behavior of the anomalous Hall signature in the presence of electron doping. The splitting of nodal line via spin-orbit coupling produces a large Berry curvature, which leads to a significant response in anomalous Hall conductivity. Upon electron doping via chemical substitution or gating, or rotation of magnetization via external magnetic field, steep change of anomalous Hall behavior occurs, which makes CCS a promising compound for low energy spintronics applications.


title: WARM: A Weakly (+Semi) Supervised Model for Solving Math word Problems

abstract: Solving math word problems (MWPs) is an important and challenging problem in natural language processing. Existing approaches to solve MWPs require full supervision in the form of intermediate equations. However, labeling every MWP with its corresponding equations is a time-consuming and expensive task. In order to address this challenge of equation annotation, we propose a weakly supervised model for solving MWPs by requiring only the final answer as supervision. We approach this problem by first learning to generate the equation using the problem description and the final answer, which we subsequently use to train a supervised MWP solver. We propose and compare various weakly supervised techniques to learn to generate equations directly from the problem description and answer. Through extensive experiments, we demonstrate that without using equations for supervision, our approach achieves accuracy gains of 4.5% and 32% over the state-of-the-art weakly supervised approach, on the standard Math23K and AllArith datasets respectively. Additionally, we curate and release new datasets of roughly 10k MWPs each in English and in Hindi (a low resource language).These datasets are suitable for training weakly supervised models. We also present an extension of WARMM to semi-supervised learning and present further improvements on results, along with insights.


title: Almost all classical theorems are intuitionistic

abstract: Canonical expressions are representative of implicative propositions upto renaming of variables. In this paper we explore, using a Monte-Carlo approach, the model of canonical expressions in order to confirm the paradox that says that asymptotically almost all classical theorems are intuitionistic.


title: Dynamic Coded Caching in Wireless Networks Using Multi-Agent Reinforcement Learning

abstract: We consider distributed caching of content across several small base stations (SBSs) in a wireless network, where the content is encoded using a maximum distance separable code. Specifically, we apply soft time-to-live (STTL) cache management policies, where coded packets may be evicted from the caches at periodic times. We propose a reinforcement learning (RL) approach to find coded STTL policies minimizing the overall network load. We demonstrate that such caching policies achieve almost the same network load as policies obtained through optimization, where the latter assumes perfect knowledge of the distribution of times between file requests as well the distribution of the number of SBSs within communication range of a user placing a request. We also suggest a multi-agent RL (MARL) framework for the scenario of non-uniformly distributed requests in space. For such a scenario, we show that MARL caching policies achieve lower network load as compared to optimized caching policies assuming a uniform request placement. We also provide convincing evidence that synchronous updates offer a lower network load than asynchronous updates for spatially homogeneous renewal request processes due to the memory of the renewal processes.


title: Energy spectrum of massive Dirac particles in gapped graphene with Morse potential

abstract: In this paper, we study the massive Dirac equation with the presence of the Morse potential in polar coordinate. The Dirac Hamiltonian is written as two second-order differential equations in terms of two spinor wavefunctions. Since the motion of electrons in graphene is propagated like relativistic fermionic quasi-particles, then one is considered only with pseudospin symmetry for aligned spin and unaligned spin by arbitrary $k$. Next, we use the confluent Heun's function for calculating the wavefunctions and the eigenvalues. Then, the corresponding energy spectrum obtains in terms of $N$ and $k$. Afterward, we plot the graphs of the energy spectrum and the wavefunctions in terms of $k$ and $r$, respectively. Moreover, we investigate the graphene band structure by a linear dispersion relation which creates an energy gap in the Dirac points called gapped graphene. Finally, we plot the graph of the valence and conduction bands in terms of wavevectors.


title: Control of a polar order via magnetic field in a vector-chiral magnet

abstract: Vector-chiral (VC) antiferromagnetism is a spiral-like ordering of spins which may allow ferroelectricity to occur due to loss of space inversion symmetry. In this paper we report direct experimental observation of ferroelectricity in the VC phase of $\beta$-TeVO$_4$, a frustrated spin chain system with pronounced magnetic anisotropy and a rich phase diagram. Saturation polarization is proportional to neutron scattering intensities that correspond to the VC magnetic reflection. This implies that inverse Dzyaloshinskii-Moriya mechanism is responsible for driving electric polarization. Linear magnetoelectric coupling is absent, however an unprecedented dependence of electric coercive field on applied magnetic field reveals a novel way of manipulating multiferroic information.


title: Silicate dielectric ceramics for millimetre wave applications

abstract: Silicate ceramics are of considerable promise as high frequency dielectrics in emerging millimetre wave applications including high bandwidth wireless communication and sensing. In this review, we show how high quality factors and low, thermally stable permittivities arise in ordered silicate structures. On the basis of a large number of existing studies, the dielectric performance of silicate ceramics is comprehensively summarized and presented, showing how microstructure and SiO4 tetrahedral connectivity affect polarizability and dielectric losses. We critically examine the appropriateness of silicate materials in future applications as effective millimetre wave dielectrics with low losses and tuneable permittivities. The development of new soft chemistry based processing routes for silicate dielectric ceramics is identified as being instrumental towards the reduction of processing temperatures, thus enabling silicate ceramics to be co-fired in the production of components functioning in the mm wave regime.


title: Adversarial Sticker: A Stealthy Attack Method in the Physical World

abstract: To assess the vulnerability of deep learning in the physical world, recent works introduce adversarial patches and apply them on different tasks. In this paper, we propose another kind of adversarial patch: the Meaningful Adversarial Sticker, a physically feasible and stealthy attack method by using real stickers existing in our life. Unlike the previous adversarial patches by designing perturbations, our method manipulates the sticker's pasting position and rotation angle on the objects to perform physical attacks. Because the position and rotation angle are less affected by the printing loss and color distortion, adversarial stickers can keep good attacking performance in the physical world. Besides, to make adversarial stickers more practical in real scenes, we conduct attacks in the black-box setting with the limited information rather than the white-box setting with all the details of threat models. To effectively solve for the sticker's parameters, we design the Region based Heuristic Differential Evolution Algorithm, which utilizes the new-found regional aggregation of effective solutions and the adaptive adjustment strategy of the evaluation criteria. Our method is comprehensively verified in the face recognition and then extended to the image retrieval and traffic sign recognition. Extensive experiments show the proposed method is effective and efficient in complex physical conditions and has a good generalization for different tasks.


title: Dichotomy of saddle points in energy bands of a monolayer NbSe$_2$

abstract: We theoretically show that two distinctive spin textures manifest themselves around saddle points of energy bands in a monolayer NbSe$_2$ under external gate potentials. While the density of states at all saddle points diverge logarithmically, ones at the zone boundaries display a windmill-shaped spin texture while the others unidirectional spin orientations. The disparate spin-resolved states are demonstrated to contribute an intrinsic spin Hall conductivity significantly while their characteristics differ from each other.Based on a minimal but essential tight-binding approximation reproducing first-principles computation results, we established distinct effective Rashba Hamiltonians for each saddle point, realizing the unique spin textures depending on their momentum. Energetic positions of the saddle points in a single layer NbSe$_2$ are shown to be well controlled by a gate potential so that it could be a prototypical system to test a competition between various collective phenomena triggered by diverging density of states and their spin textures in low-dimension.


title: Weakly But Deeply Supervised Occlusion-Reasoned Parametric Road Layouts

abstract: We propose an end-to-end network that takes a single perspective RGB image of a complex road scene as input, to produce occlusion-reasoned layouts in perspective space as well as a parametric bird's-eye-view (BEV) space. In contrast to prior works that require dense supervision such as semantic labels in perspective view, our method only requires human annotations for parametric attributes that are cheaper and less ambiguous to obtain. To solve this challenging task, our design is comprised of modules that incorporate inductive biases to learn occlusion-reasoning, geometric transformation and semantic abstraction, where each module may be supervised by appropriately transforming the parametric annotations. We demonstrate how our design choices and proposed deep supervision help achieve meaningful representations and accurate predictions. We validate our approach on two public datasets, KITTI and NuScenes, to achieve state-of-the-art results with considerably less human supervision.


title: High Order Residual Distribution Conservative Finite Difference HWENO Scheme for Steady State Problems

abstract: In this paper, we develop a high order residual distribution (RD) method for solving steady state conservation laws in a novel Hermite weighted essentially non-oscillatory (HWENO) framework recently developed in [24]. In particular, we design a high order HWENO integration for the integrals of source term and fluxes based on the point value of the solution and its spatial derivatives, and the principles of residual distribution schemes are adapted to obtain steady state solutions. Two advantages of the novel HWENO framework have been shown in [24]: first, compared with the traditional HWENO framework, the proposed method does not need to introduce additional auxiliary equations to update the derivatives of the unknown variable, and just compute them from the current point value of the solution and its old spatial derivatives, which saves the computational storage and CPU time, and thereby improve the computational efficiency of the traditional HWENO framework. Second, compared with the traditional WENO method, reconstruction stencil of the HWENO methods becomes more compact, their boundary treatment is simpler, and the numerical errors are smaller at the same grid. Thus, it is also a compact scheme when we design the higher order accuracy, compared with that in [11] Chou and Shu proposed. Extensive numerical experiments for one- and two-dimensional scalar and systems problems confirm the high order accuracy and good quality of our scheme.


title: The even parity Goldfeld conjecture: congruent number elliptic curves

abstract: In 1979 Goldfeld conjectured: 50\% of the quadratic twists of an elliptic curve defined over the rationals have analytic rank zero. In this expository article we present a few recent developments towards the conjecture, especially its first instance - the congruent number elliptic curves.


title: Non-resonant circles for strong magnetic fields on surfaces

abstract: We study non-resonant circles for strong magnetic fields on a closed, connected, oriented surface and show how these can be used to prove the existence of trapping regions and of periodic magnetic geodesics with prescribed low speed. As a corollary, there exist infinitely many periodic magnetic geodesics for every low speed in the following cases: i) the surface is not the two-sphere, ii) the magnetic field vanishes somewhere.


title: Anisotropic heating and magnetic field generation due to Raman scattering in laser-plasma interactions

abstract: We identify a mechanism for magnetic field generation in the interaction of intense electromagnetic waves and underdense plasmas. We show that Raman scattered plasma waves trap and heat the electrons preferentially in their propagation direction, resulting in a temperature anisotropy. In the trail of the laser pulse, we observe magnetic field growth which matches the Weibel mechanism due to the temperature anisotropy. We discuss the role of the initial electron temperature in our results. The predictions are confirmed with multi-dimensional particle-in-cell simulations. We show how this configuration is an experimental platform to study the long-time evolution of the Weibel instability.


title: Enabling Machine Learning Algorithms for Credit Scoring -- Explainable Artificial Intelligence (XAI) methods for clear understanding complex predictive models

abstract: Rapid development of advanced modelling techniques gives an opportunity to develop tools that are more and more accurate. However as usually, everything comes with a price and in this case, the price to pay is to loose interpretability of a model while gaining on its accuracy and precision. For managers to control and effectively manage credit risk and for regulators to be convinced with model quality the price to pay is too high. In this paper, we show how to take credit scoring analytics in to the next level, namely we present comparison of various predictive models (logistic regression, logistic regression with weight of evidence transformations and modern artificial intelligence algorithms) and show that advanced tree based models give best results in prediction of client default. What is even more important and valuable we also show how to boost advanced models using techniques which allow to interpret them and made them more accessible for credit risk practitioners, resolving the crucial obstacle in widespread deployment of more complex, 'black box' models like random forests, gradient boosted or extreme gradient boosted trees. All this will be shown on the large dataset obtained from the Polish Credit Bureau to which all the banks and most of the lending companies in the country do report the credit files. In this paper the data from lending companies were used. The paper then compares state of the art best practices in credit risk modelling with new advanced modern statistical tools boosted by the latest developments in the field of interpretability and explainability of artificial intelligence algorithms. We believe that this is a valuable contribution when it comes to presentation of different modelling tools but what is even more important it is showing which methods might be used to get insight and understanding of AI methods in credit risk context.


title: Modeling pressure pulsation and backflow in progressing cavity pumps with deformable stator

abstract: This contribution studies the impact of the rotor-stator interaction in a single-stage progressing cavity pump on the flow rate and pressure. Specifically, we investigate the effect of the rotor movement on the sealings formed with deformable stators for various speeds and pressures. Sealings are reconstructed with the help of a geometric 3D model. We analyze the tangential and radial deviation of the rotor from its reference path and show that the radial deviation affects the flow rate, whereas the tangential deviation affects the pressure dynamics. The conjectures are confirmed with a laboratory test setup.


title: Natural-Language Multi-Agent Simulations of Argumentative Opinion Dynamics

abstract: This paper develops a natural-language agent-based model of argumentation (ABMA). Its artificial deliberative agents (ADAs) are constructed with the help of so-called neural language models recently developed in AI and computational linguistics. ADAs are equipped with a minimalist belief system and may generate and submit novel contributions to a conversation. The natural-language ABMA allows us to simulate collective deliberation in English, i.e. with arguments, reasons, and claims themselves -- rather than with their mathematical representations (as in formal models). This paper uses the natural-language ABMA to test the robustness of formal reason-balancing models of argumentation [Maes & Flache 2013, Singer et al. 2019]: First of all, as long as ADAs remain passive, confirmation bias and homophily updating trigger polarization, which is consistent with results from formal models. However, once ADAs start to actively generate new contributions, the evolution of a conservation is dominated by properties of the agents *as authors*. This suggests that the creation of new arguments, reasons, and claims critically affects a conversation and is of pivotal importance for understanding the dynamics of collective deliberation. The paper closes by pointing out further fruitful applications of the model and challenges for future research.


title: A characterisation of $L_1$-preduals in terms of extending Lipschitz maps

abstract: We characterise the Banach spaces $X$ which are $L_1$-predual as those for which every Lipschitz compact mapping $f:N\longrightarrow X$ admits, for every $\varepsilon>0$ and every $M$ containing $N$, a Lipschitz (compact) extension $F:M\longrightarrow X$ so that $\Vert F\Vert\leq (1+\varepsilon)\Vert f\Vert$. Some consequences are derived about $L_1$-preduals and about Lipschitz-free spaces.


title: Cu Modified SrTiO3 Perovskites Toward Enhanced Water Gas Shift Catalysis: A Combined Experimental and Computational Study

abstract: The water gas shift reaction (WGS) is important and widely applied in the production of H2. Cu modified perovskites are promising catalysts for WGS reactions in hydrogen generation. However, the structure-dependent stability and reaction pathways of such materials remain unclear. Herein, we report catalytically active Cu modified SrTiO3 (nominally SrTi1-xCuxO3) prepared by a modified polymeric precursor method. Microstructural analysis revealed a partially segregated CuO phase in the as-prepared materials. Operando X-ray diffraction and absorption spectroscopy showed the reduction of CuO into a stable metallic phase under conditions of WGS reactions for all compositions. Among the characterized materials, the x = 0.20 composition showed the highest turnover frequency, lowest activation energy, and the highest WGS rate at 300C. According to density functional calculations, the formation of CuO is energetically less favorable compared with SrTiO3, explaining why the segregated CuO phase on the SrTiO3 surface is reduced to Cu during the catalytic reaction, while SrTiO3 remains. For x = 0.20, the size of the segregated CuO phase is optimum for facilitating the catalytic reaction. In contrast, a higher Cu content (x = 0.3) results in an aggregation of smaller CuO particles, resulting in fewer surface active sites and a net decrease in catalytic performance.


title: Engineering Predecessor Data Structures for Dynamic Integer Sets

abstract: We present highly optimized data structures for the dynamic predecessor problem, where the task is to maintain a set $S$ of $w$-bit numbers under insertions, deletions, and predecessor queries (return the largest element in $S$ no larger than a given key). The problem of finding predecessors can be viewed as a generalized form of the membership problem, or as a simple version of the nearest neighbour problem. It lies at the core of various real-world problems such as internet routing. In this work, we engineer (1) a simple implementation of the idea of universe reduction, similar to van-Emde-Boas trees (2) variants of y-fast tries [Willard, IPL'83], and (3) B-trees with different strategies for organizing the keys contained in the nodes, including an implementation of dynamic fusion nodes [P\v{a}tra\c{s}cu and Thorup, FOCS'14]. We implement our data structures for $w=32,40,64$, which covers most typical scenarios. Our data structures finish workloads faster than previous approaches while being significantly more space-efficient, e.g., they clearly outperform standard implementations of the STL by finishing up to four times as fast using less than a third of the memory. Our tests also provide more general insights on data structure design, such as how small sets should be stored and handled and if and when new CPU instructions such as advanced vector extensions pay off.


title: Diophantine problems over $\mathbb{Z}^{ab}$ modulo prime numbers

abstract: Let $\mathbb{Z}^{ab}$ be the ring of integers of $\mathbb{Q}^{ab}$, the maximal abelian extension of $\mathbb{Q}$. We show that there exists an algorithm to decide whether a system of equations and inequations, with integer coefficients, has a solution in $\mathbb{Z}^{ab}$ modulo every rational prime.


title: Optimal Downlink Training Sequence for Massive MIMO Secret-Key Generation

abstract: In this paper, the secret-key capacity is maximized by optimizing the downlink training sequence in a time division duplexing (TDD) massive multiple-input-multiple-output (MIMO) scenario. Both single-user and multiple user cases are considered. As opposed to previous works, the optimal training sequence and the related secret-key capacity is characterized in closed-form in the single-user case and the large antenna multiple-user case. Designs taking into account a constraint on the maximal number of pilots are also proposed. In the multiple-user case, both the max-min and the sum capacity criteria are considered, including potential user priorities. In the end, it is shown that massive MIMO boosts the secret-key capacity by leveraging: i) spatial dimensionality gain and ii) array gain. Moreover, in the large antenna case, the multiple-user capacity is obtained with no extra pilot overhead as compared to the single-user case.


title: Early-Type (E, S0) Galaxies in the Catalog of Isolated Galaxies (KIG)

abstract: We use the data of modern digital sky surveys (PanSTARRS-1, SDSS) combined with HI-line and far ultraviolet (GALEX) surveys to reclassify 165 early-type galaxies from the Catalog of Isolated Galaxies (KIG). As a result, the number of E- and S0-type galaxies reduced to 91. Our search for companions of early-type KIG galaxies revealed 90 companions around 45 host galaxies with line-of-sight velocity differences $|dV| < 500$ km s$^{-1}$ and linear projected separations $R_{p} < 750$ kpc. We found no appreciable differences in either integrated luminosity or color of galaxies associated with the presence or absence of close neighbors. We found a characteristic orbital mass-to-luminosity ratio for 26 systems "KIG galaxy--companion" to be $M_{\odot}/L_{K} = (74\pm26) M_{\odot}/L_{\odot}$, which is consistent with the $M_{\rm orb}/L_{K}$ estimates for early-type isolated galaxies in the 2MIG catalog ($63 M_{\odot}/L_{\odot}$), and also with the $M_{\rm orb}/L_{K}$ estimates for E- and S0-type galaxies in the Local Volume: $38\pm22$ (NGC 3115), $82\pm26$ (NGC 5128), $65\pm20$ (NGC 4594). The high halo-to-stellar mass ratio for E- and S0-type galaxies compared to the average $(20\pm3) M_{\odot}/L_{\odot}$ ratio for bulgeless spiral galaxies is indicative of a significant difference between the dynamic evolution of early- and late-type galaxies.


title: Defending Against Adversarial Denial-of-Service Data Poisoning Attacks

abstract: Data poisoning is one of the most relevant security threats against machine learning and data-driven technologies. Since many applications rely on untrusted training data, an attacker can easily craft malicious samples and inject them into the training dataset to degrade the performance of machine learning models. As recent work has shown, such Denial-of-Service (DoS) data poisoning attacks are highly effective. To mitigate this threat, we propose a new approach of detecting DoS poisoned instances. In comparison to related work, we deviate from clustering and anomaly detection based approaches, which often suffer from the curse of dimensionality and arbitrary anomaly threshold selection. Rather, our defence is based on extracting information from the training data in such a generalized manner that we can identify poisoned samples based on the information present in the unpoisoned portion of the data. We evaluate our defence against two DoS poisoning attacks and seven datasets, and find that it reliably identifies poisoned instances. In comparison to related work, our defence improves false positive / false negative rates by at least 50%, often more.


title: The Schr\"odinger particle on the half-line with an attractive $\delta$-interaction: bound states and resonances

abstract: In this paper we provide a detailed description of the eigenvalue $ E_{D}(x_0)\leq 0$ (respectively $ E_{N}(x_0)\leq 0$) of the self-adjoint Hamiltonian operator representing the negative Laplacian on the positive half-line with a Dirichlet (resp. Neuman) boundary condition at the origin perturbed by an attractive Dirac distribution $-\lambda \delta(x-x_0)$ for any fixed value of the magnitude of the coupling constant. We also investigate the $\lambda$-dependence of both eigenvalues for any fixed value of $x_0$. Furthermore, we show that both systems exhibit resonances as poles of the analytic continuation of the resolvent. These results will be connected with the study of the ground state energy of two remarkable three-dimensional self-adjoint operators, studied in depth in Albeverio's monograph, perturbed by an attractive $\delta$-distribution supported on the spherical shell of radius $r_0$.


title: Multi-parameter optimization of attenuation data for characterizing grain size distributions and application to bimodal microstructures

abstract: In this paper, the effect on the ultrasonic attenuation of the grain size heterogeneity in polycrystals is analyzed. First, new analytical developments allowing the extension of the unified theory of Stanke and Kino to general grain size distributions are presented. It is then shown that one can additively decompose the attenuation coefficient provided that groups of grains are defined. Second, the study is specialized to a bimodal distribution of the grain size for which microstructures are numerically modeled by means of the software Neper. The additive partition of the attenuation coefficient into contributions coming from large and small grains motivates the derivation of an optimization procedure for characterizing the grain size distribution. The aforementioned approach, which is based on a least squares minimization, is at last presented and illustrated on both analytical and numerical attenuation data. It is thus shown that the method provides satisfying approximations of volume fractions of large grains and modal equivalent diameters from the frequency-dependent attenuation coefficient.


title: Ratio of kaon and pion leptonic decay constants with $N_f = 2 + 1 + 1$ Wilson-clover twisted-mass fermions

abstract: We present a determination of the ratio of kaon and pion leptonic decay constants in isosymmetric QCD (isoQCD), $f_K / f_\pi$, making use of the gauge ensembles produced by the Extended Twisted Mass Collaboration (ETMC) with $N_f = 2 + 1 + 1$ flavors of Wilson-clover twisted-mass quarks, including configurations close to the physical point for all dynamical flavors. The simulations are carried out at three values of the lattice spacing ranging from $\sim 0.068$ to $\sim 0.092$ fm with linear lattice size up to $L \sim 5.5$~fm. The scale is set by the PDG value of the pion decay constant, $f_\pi^{isoQCD} = 130.4~(2)$ MeV, at the isoQCD pion point, $M_\pi^{isoQCD} = 135.0~(2)$ MeV, obtaining for the gradient-flow (GF) scales the values $w_0 = 0.17383~(63)$ fm, $\sqrt{t_0} = 0.14436~(61)$ fm and $t_0 / w_0 = 0.11969~(62)$ fm. The data are analyzed within the framework of SU(2) Chiral Perturbation Theory (ChPT) without resorting to the use of renormalized quark masses. At the isoQCD kaon point $M_K^{isoQCD} = 494.2~(4)$ MeV we get $(f_K / f_\pi)^{isoQCD} = 1.1995~(44)$, where the error includes both statistical and systematic uncertainties. Implications for the Cabibbo-Kobayashi-Maskawa (CKM) matrix element $|V_{us}|$ and for the first-row CKM unitarity are discussed.


title: Best proximity points in ultrametric spaces

abstract: In the present paper, we study the existence of best proximity pair in ultrametric spaces. We show, under suitable assumptions, that the proximinal pair $(A,B)$ has a best proximity pair. As a consequence we generalize a well known best approximation result and we derive some fixed point theorems. Moreover, we provide examples to illustrate the obtained results.


title: The water-ice line as a birthplace of planets: Implications of a species-dependent dust fragmentation threshold

abstract: The thermodynamic structure of protoplanetary discs is determined by dust opacities, which depend on the size of the dust grains and their chemical composition. In the inner regions, the grain sizes are regulated by the level of turbulence (e.g. $\alpha$ viscosity) and by the dust fragmentation velocity that represents the maximal velocity that grains can have at a collision before they fragment. Here, we perform self-consistently calculated 2D hydrodynamical simulations that consider a full grain size distribution of dust grains with a transition in the dust fragmentation velocity at the water-ice line. This approach accounts for the results of previous particle collision laboratory experiments, in which silicate particles typically have a lower dust fragmentation velocity than water-ice particles. Furthermore, we probe the effects of variations in the water abundance, the dust-to-gas ratio, and the turbulence parameter on the disc structure. For the discs with a transition in the dust fragmentation velocity at the water-ice line, we find a narrow but striking zone of planetary outward migration, including for low viscosities. In addition, we find a bump in the radial pressure gradient profile that tends to be located slightly inside the ice line. Both of these features are present for all tested disc parameters. Thus, we conclude that the ice line can function both as a migration trap, which can extend the growth times of planets before they migrate to the inner edge of the protoplanetary disc, and as a pressure trap, where planetesimal formation can be initiated or enhanced.


title: Quadratic GCN for Graph Classification

abstract: Graph Convolutional Networks (GCNs) have been extensively used to classify vertices in graphs and have been shown to outperform other vertex classification methods. GCNs have been extended to graph classification tasks (GCT). In GCT, graphs with different numbers of edges and vertices belong to different classes, and one attempts to predict the graph class. GCN based GCT have mostly used pooling and attention-based models. The accuracy of existing GCT methods is still limited. We here propose a novel solution combining GCN, methods from knowledge graphs, and a new self-regularized activation function to significantly improve the accuracy of the GCN based GCT. We present quadratic GCN (QGCN) - A GCN formalism with a quadratic layer. Such a layer produces an output with fixed dimensions, independent of the graph vertex number. We applied this method to a wide range of graph classification problems, and show that when using a self regularized activation function, QGCN outperforms the state of the art methods for all graph classification tasks tested with or without external input on each graph. The code for QGCN is available at: https://github.com/Unknown-Data/QGCN .


title: Is Multi-Hop Reasoning Really Explainable? Towards Benchmarking Reasoning Interpretability

abstract: Multi-hop reasoning has been widely studied in recent years to obtain more interpretable link prediction. However, we find in experiments that many paths given by these models are actually unreasonable, while little works have been done on interpretability evaluation for them. In this paper, we propose a unified framework to quantitatively evaluate the interpretability of multi-hop reasoning models so as to advance their development. In specific, we define three metrics including path recall, local interpretability, and global interpretability for evaluation, and design an approximate strategy to calculate them using the interpretability scores of rules. Furthermore, we manually annotate all possible rules and establish a Benchmark to detect the Interpretability of Multi-hop Reasoning (BIMR). In experiments, we run nine baselines on our benchmark. The experimental results show that the interpretability of current multi-hop reasoning models is less satisfactory and is still far from the upper bound given by our benchmark. Moreover, the rule-based models outperform the multi-hop reasoning models in terms of performance and interpretability, which points to a direction for future research, i.e., we should investigate how to better incorporate rule information into the multi-hop reasoning model. Our codes and datasets can be obtained from https://github.com/THU-KEG/BIMR.


title: Influence of individual nodes for continuous-time Susceptible-Infected-Susceptible dynamics on synthetic and real-world networks

abstract: In the study of epidemic dynamics a fundamental question is whether a pathogen initially affecting only one individual will give rise to a limited outbreak or to a widespread pandemic. The answer to this question crucially depends not only on the parameters describing the infection and recovery processes but also on where, in the network of interactions, the infection starts from. We study the dependence on the location of the initial seed for the Susceptible-Infected-Susceptible epidemic dynamics in continuous time on networks. We first derive analytical predictions for the dependence on the initial node of three indicators of spreading influence (probability to originate an infinite outbreak, average duration and size of finite outbreaks) and compare them with numerical simulations on random uncorrelated networks, finding a very good agreement. We then show that the same theoretical approach works fairly well also on a set of real-world topologies of diverse nature. We conclude by briefly investigating which topological network features determine deviations from the theoretical predictions.


title: Measures Form a Complete Lattice

abstract: We show that the set of all measures on any measurable space is a complete lattice, i.e. every collection of measures has both a greatest lower bound and a least upper bound.


title: Noncatastrophic convolutional codes over a finite ring

abstract: Noncatastrophic encoders are an important class of polynomial generator matrices of convolutional codes. When these polynomials have coefficients in a finite field, these encoders have been characterized are being polynomial left prime matrices. In this paper we study the notion of noncatastrophicity in the context of convolutional codes when the polynomial matrices have entries in a finite ring. In particular, we need to introduce two different notion of primeness in order to fully characterize noncatastrophic encoders over the finite ring Z_{p^r}. The second part of the paper is devoted to investigate the notion of free and column distance in this context when the convolutional code is a free finitely generated Z_{p^r}-module. We introduce the notion of b-degree and provide new bounds on the free distances and column distance. We show that this class of convolutional codes is optimal with respect to the column distance and to the free distance if and only if its projection on Z_p is.


title: An improved bilinear restriction estimate for paraboloid in $\mathbb{R}^3$

abstract: We obtain a sharp bilinear restriction estimate for paraboloid in $\mathbb{R}^3$ for $q>3.25$.


title: A Survey of the Hadamard Maximal Determinant Problem

abstract: In a celebrated paper of 1893, Hadamard established the maximal determinant theorem, which establishes an upper bound on the determinant of a matrix with complex entries of norm at most $1$. His paper concludes with the suggestion that mathematicians study the maximum value of the determinant of an $n \times n$ matrix with entries in $\{ \pm 1\}$. This is the Hadamard maximal determinant problem. This survey provides complete proofs of the major results obtained thus far. We focus equally on upper bounds for the determinant (achieved largely via the study of the Gram matrices), and constructive lower bounds (achieved largely via quadratic residues in finite fields and concepts from design theory). To provide an impression of the historical development of the subject, we have attempted to modernise many of the original proofs, while maintaining the underlying ideas. Thus some of the proofs have the flavour of determinant theory, and some appear in print in English for the first time. We survey constructions of matrices in order $n \equiv 3 \mod 4$, giving asymptotic analysis which has not previously appeared in the literature. We prove that there exists an infinite family of matrices achieving at least $0.48$ of the maximal determinant bound. Previously the best known constant for a result of this type was $0.34$.


title: VTGAN: Semi-supervised Retinal Image Synthesis and Disease Prediction using Vision Transformers

abstract: In Fluorescein Angiography (FA), an exogenous dye is injected in the bloodstream to image the vascular structure of the retina. The injected dye can cause adverse reactions such as nausea, vomiting, anaphylactic shock, and even death. In contrast, color fundus imaging is a non-invasive technique used for photographing the retina but does not have sufficient fidelity for capturing its vascular structure. The only non-invasive method for capturing retinal vasculature is optical coherence tomography-angiography (OCTA). However, OCTA equipment is quite expensive, and stable imaging is limited to small areas on the retina. In this paper, we propose a novel conditional generative adversarial network (GAN) capable of simultaneously synthesizing FA images from fundus photographs while predicting retinal degeneration. The proposed system has the benefit of addressing the problem of imaging retinal vasculature in a non-invasive manner as well as predicting the existence of retinal abnormalities. We use a semi-supervised approach to train our GAN using multiple weighted losses on different modalities of data. Our experiments validate that the proposed architecture exceeds recent state-of-the-art generative networks for fundus-to-angiography synthesis. Moreover, our vision transformer-based discriminators generalize quite well on out-of-distribution data sets for retinal disease prediction.


title: Reconfigurable Intelligent Surface-Assisted Aerial-Terrestrial Communications via Multi-Task Learning

abstract: The aerial-terrestrial communication system constitutes an efficient paradigm for supporting and complementing terrestrial communications. However, the benefits of such a system cannot be fully exploited, especially when the line-of-sight (LoS) transmissions are prone to severe deterioration due to complex propagation environments in urban areas. The emerging technology of reconfigurable intelligent surfaces (RISs) has recently become a potential solution to mitigate propagation-induced impairments and improve wireless network coverage. Motivated by these considerations, in this paper, we address the coverage and link performance problems of the aerial-terrestrial communication system by proposing an RIS-assisted transmission strategy. In particular, we design an adaptive RIS-assisted transmission protocol, in which the channel estimation, transmission strategy, and data transmission are independently implemented in a frame. On this basis, we formulate an RIS-assisted transmission strategy optimization problem as a mixed-integer non-linear program (MINLP) to maximize the overall system throughput. We then employ multi-task learning to speed up the solution to the problem. Benefiting from multi-task learning, the computation time is reduced by about four orders of magnitude. Numerical results show that the proposed RIS-assisted transmission protocol significantly improves the system throughput and reduces the transmit power.


title: Polymer-Derived SiOC Integrated with a Graphene Aerogel As a Highly Stable Li-Ion Battery Anode

abstract: Amorphous polymer derived silicon oxycarbide (SiOC) is an attractive candidate for Lithium ion battery anodes, as an alternative to graphite, which is limited to a theoretical capacity of 372 mAh/g. However, SiOC tends to exhibit poor transport properties and cycling performance as a result of sparsely distributed carbon clusters and inefficient active sites. To overcome these limitations, we designed and fabricated a layered graphene SiOC heterostructure by solvent assisted infiltration of a polymeric precursor into a modified three dimensional graphene aerogel skeleton. The use of a high melting point solvent facilitated the precursors freeze drying, which following pyrolysis yielded SiOC as a layer supported on the surface of nitrogen doped reduced graphene oxide aerogels. The fabrication method employed here modifies the composition and microstructure of the SiOC phase. Among the studied materials, the highest levels of performance were obtained for a sample of moderate SiOC content, in which the graphene network constituted 19.8 wt % of the system. In these materials, a stable reversible charge capacity of 751 mAh/g was achieved at low charge rates. At high charge rates of 1480 mA/g, the capacity retention was ca. 95% (352 mAh/g) after 1000 consecutive cycles. At all rates, Coulombic efficiencies greater than 99% were maintained following the first cycle. Performance across all indicators was majorly improved in the graphene aerogel SiOC nanocomposites, compared with unsupported SiOC. The performance was attributed to mechanisms across multiple length scales. The presence of oxygen rich SiO4-xCx tetrahedral units and a continuous free carbon network within the SiOC provides sites for reversible lithiation, while high ionic and electronic transport is provided by the layered graphene SiOC heterostructure.


title: Crystal Growth of the Quasi-2D Quarternary Compound AgCrP$_2$S$_6$ by Chemical Vapor Transport

abstract: We report optimized crystal growth conditions for the quarternary compound AgCrP$_2$S$_6$ by chemical vapor transport. Compositional and structural characterization of the obtained crystals were carried out by means of energy-dispersive X-ray spectroscopy and powder X-ray diffraction. AgCrP$_2$S$_6$ is structurally closely related to the $M_2$P$_2$S$_6$ family, which contains several compounds that are under investigation as 2D magnets. As-grown crystals exhibit a plate-like, layered morphology as well as a hexagonal habitus. AgCrP$_2$S$_6$ crystallizes in monoclinic symmetry in the space group $P2/a$ (No. 13). The successful growth of large high-quality single crystals paves the way for further investigations of low dimensional magnetism and its anisotropies in the future and may further allow for the manufacturing of few-layer (or even monolayer) samples by exfoliation.


title: Towards NIR-VIS Masked Face Recognition

abstract: Near-infrared to visible (NIR-VIS) face recognition is the most common case in heterogeneous face recognition, which aims to match a pair of face images captured from two different modalities. Existing deep learning based methods have made remarkable progress in NIR-VIS face recognition, while it encounters certain newly-emerged difficulties during the pandemic of COVID-19, since people are supposed to wear facial masks to cut off the spread of the virus. We define this task as NIR-VIS masked face recognition, and find it problematic with the masked face in the NIR probe image. First, the lack of masked face data is a challenging issue for the network training. Second, most of the facial parts (cheeks, mouth, nose etc.) are fully occluded by the mask, which leads to a large amount of loss of information. Third, the domain gap still exists in the remaining facial parts. In such scenario, the existing methods suffer from significant performance degradation caused by the above issues. In this paper, we aim to address the challenge of NIR-VIS masked face recognition from the perspectives of training data and training method. Specifically, we propose a novel heterogeneous training method to maximize the mutual information shared by the face representation of two domains with the help of semi-siamese networks. In addition, a 3D face reconstruction based approach is employed to synthesize masked face from the existing NIR image. Resorting to these practices, our solution provides the domain-invariant face representation which is also robust to the mask occlusion. Extensive experiments on three NIR-VIS face datasets demonstrate the effectiveness and cross-dataset-generalization capacity of our method.


title: A renormalization group study of the dynamics of active membranes: universality classes and scaling laws

abstract: Motivated by experimental observations of patterning at the leading edge of motile eukaryotic cells, we introduce a general model for the dynamics of nearly-flat fluid membranes driven from within by an ensemble of activators. We include, in particular, a kinematic coupling between activator density and membrane slope which generically arises whenever the membrane has a non-vanishing normal speed. We unveil the phase diagram of the model by means of a perturbative field-theoretical renormalization group analysis. Due to the aforementioned kinematic coupling the natural dynamical scaling is acoustic, that is the dynamical critical exponent is 1. However, as soon as the the normal velocity of the membrane is tuned to zero, the system crosses over to diffusive dynamic scaling in mean field. Distinct critical points can be reached depending on how the limit of vanishing velocity is realised: in each of them corrections to scaling due to nonlinear coupling terms must be taken into accounts. The detailed analysis of these critical points reveals novel scaling regimes wich can be accessed with perturbative methods, together with signs of strong coupling behaviour, which establishes a promising ground for further non-perturbative calculations. Our results unify several previous studies on the dynamics of active membrane, while also identifying nontrivial scaling regimes which cannot be captured by passive theories of fluctuating interfaces and are relevant for the physics of living membranes.